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PREFACE 


It has been said of the THEORY OF GAMES AND ECONOMIC BEHAVIOR by 
John von Neumann and Oskar Morgens tern that "posterity may regard this 
book as one of the major scientific achievements of the first half of the 
twentieth century."^ At the beginning of the second half of the twentieth 
century the theory of games continues to be an object of vigorous and ex¬ 
panding research, as the papers assembled in the present Study amply 
demonstrate. The authors of these papers have not been content just to 
solve outstanding problems and elaborate existing results but have gone on 
to raise fresh problems and extend .theory in new ^^irections. 

This Study is a sequel to CONTRIBUTIONS TO THEORY OP GAMES, 
Volume I (Annals of Mathematics Study No. 2k, Princeton, 1950). The 
continuity of research bridging the two volumes is evidenced by the fact 
that some of the problems posed in the Preface to Study 2k are now solved 
in this Study. On the other hand, some reorganization has taxen place. 

The simple division of Study 2k into two parts, dealing with finite and 
with infinite garner, has been replaced by a division of this Study into 
four parts: finite zero-sum two-person games, infinite zero-sum two-person 
games, games in extensive form, and general n-person games. (The mounting 
Interest in n-person games and extensive games is quite striking; scarcely 
touched in Study 2k, they now occupy fully half of this Study.) Each of 
the four parts is prefaced by an introduction that describes the papers 
therein and their interconnections. At the same time these introductions 
are designed to indicate how the four parts relate to one another. The 
newcomer to game theory is referred to the Preface In Study 2k for a gen¬ 
eral expository introduction to the problems of contenporary research in 
the field. 


^A. H. Copeland, Bulletin of the American Mathematical Society 51 (19^5) 
p. 498. 
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PREFACE 


The Bibliography at the end of this Study supplements the Bibli¬ 
ography in Study 24. Recent publications have been added and some omis¬ 
sions filled in, but the previous listings >iave not been repeated. Many of 
the new items, particularly those in economics journals, have been obtained 
from a bibliography on the theory of games prepared by 0. Morgenstern. 

The editing ar^d preparing of this Study have been done at 
Princeton University, in the Department of Mathematics, as part of the 
work of a Logistics Project sponsored by the Office of Naval Research. 
Members of the Project who have participated in the task have been 
C. H. Bernstein, D. B. Gillies, I. Glicksberg, R. C. Lyndon, H. Mills, 

H. Rogers Jr., R. J. Se^^le, L. S. Shapley, G. L. Thompson, and the under¬ 
signed. Papers for the Study were refereed by members of the Project with 
the generous assistance of D. Gale, B. R. Gelbaum, G. K. Kalisch, 

J. Laderraan, J. P. Mayberry, J. P. Nash, E. D. Nering, and J. von Neumann. 
The typing of the master copy has been the painstaking work of 
Mrs- S. H. Robinson. The gooa services of the Princeton University Press 
have been ever available ttirough its Science Editor, H. S. Bailey, Jr. 

To all these individuals, for their friendly cooperation, we express our 
sincere thanks. 


December 1952 


H. W. Kuhn 

A. W. Tucker 
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FINITE ZERO-SUM TWO-PERSON GAMES 


This paper was translated from Germein notes of J. von Ne\iinann (made in 
1929 ) and arranged for publication by J. P. Mayberry and D. B. Gillies 
with the active collaboration of Professor von Neumann. 

The "double description method" treated in PAPER 5 ia a procedure 
devised by T. S. Motzkln for calculating the full set of solutions of a 
system of linear inequalities and developed Independently by H. Raiffa, 

G. L. Thompson and R. M. Thrall as an algorithm for confuting the solutions 
of a zero-sum two-person game. Here the four authors have joined forces 
to explain their common method. To find the optimal mixed strategies of 
player I in a game with matrix A = > vhere 1 - l, ..., ra and 

j = 1, ..., n, they seek those points of the (m - 1)-dimensional simplex 

> 0 , • • •, > 0; + • • • + Ijn == ■* 

over which the (m - 1 )-dimensional hypersurface 

z = min ^i^ij) 

J 

attains its maximum elevation. The vertices (extreme points) of this 
concave polyhedral surface are effectively calculated by the double 
description method. Tie virtues of the method lie in the simplicity of 
the Individual steps, each of which amo\ints to the calculation of the 
intersection of a straight line with a hyperplane, and in the fact that all 
optimal mixed strategies are obtained. In a final section the method is 
applied to a general system of linear inequalities. 

The fact that solutions cf zero-suii two-person games can be 
obtained as fixed points of appropriate mappings has been known since the 
Oi-iglnal existence proof of von Neumann. M. Dresher and S. Karlin utilize 
this fact in PAPER to construct an algorithm for the solution of any 
"convex game:" namely, a game determined by a bilinear payoff fmctlon 
Air,s) of mixed strategies r a^id s, that range over compact convex 
sets in Euclidean m-space and n-space, for players I and II, respectively. 
To such games the authors extend theorems known for finite zero-sum two- 
person games and polynomial-like games, both of which are readily seen to 
constitute subclasses of the class of convex games. 

In PAPER 5 K. J. Arrow, E. W. Barankin, and D. Blackwell 
establish the following theorem concerning a closed convex set S in 
Euclidean n-space. Call a point s = (s^, ..., of S "admissible" 

if there is no point t * (t^, in S that is distinct from s 

and such that t^ < s^^ for 1*1, ..., n, and denote by B the set of 
all points of S through which pass at least one supporting hyperplane 
whose normal has all conponents positive. Then every point of B is 
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admissible and every admissible point of S is a limit of points in B. 

It is a siii 5 )le by-product of tlriis theorem that every pure strategy which 
achieves the value of a zero-sum two-person game against all opposing 
optimal mixed strategies appears with positive probability in some optimal 
mixed strategy. 


H. W. K. 
A. W. T. 




A CERTAIN ZERO-SUM TWO-PERSON GAME EQUIVALENT TO 
THE OPTIMAL ASSIGNMENT PROBLEM^ 

John von Neumann 


The optimal assignment problem Is as follows: given n persons 
and n jobs, and a set of real numbers a^ each representing the value 
of the 1 person In the j job, what assignments of persons to jobs 
will yield maximum total value? A solution can be expressed as a permuta¬ 
tion of n objects, or, equivalently, as an n x n permutation matrix. 


(Such a matrix can be expressed by cT 


where 6 


Ij 


Is the Kronecker 


symbol and 1^ Is the Image of 1 ^ under permutation P.) The value 

of a particular assignment (i.e., permutation) P will be 2i P* With¬ 
out further investigation, a direct solution of the problem appears 

to require ni steps, — the testing of each permutation to find the 


optimal permutations giving the maximum Si ®- 


¥e observe that the solution Is 


1 , 1 ^ 


P‘ 


transformation 


-> ^ij * 


where 


Invariant under the matrix 


and 


Vj are any sets of 


constants. It Is clear that u^ + added to each assign¬ 

ment value, and that thus the order of values, particularly the maxima, 
will be preserved. This enables us to transform a given assignment problem 
with possibly negative a^^j to an equivalent one with strictly positive 
aij, by adding large enough positive u^ and Vj. 

We shall now construct a certain related 2 -person game and we 
shall show that the extreme optimal strategies can be expressed in terms of 
the optimal permutation matrices In the assignment problem. (The game 
matrix for this game will be 2 n x n^. Prom this it is not difficult to 
infer how many steps are needed to get significant approximate solutions 
with the method of G. W. Brown and J. von Neumann. [Cf.; "Contributions 
to the Theory of (James," Annals of Mathematics Studies, No. 24, Princeton 
University Press, 1950 -- pp. 75-79, especially $ 5-1 It turns out that 
this number Is a moderate power of n, i.e., considerably smaller than the 
"obvious" estimate ni mentioned earlier.) 


^Editors* Note: This is a transcript, prepared under Office of Naval 
Research sponsorship by Hartley Rogers, Jr., of a seminar talk given by 
Professor von Neumann at Princeton University, October 26 , 1951 . 
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VON NEUMANN 


We first construct a simple preliminary game, the l- dimensional 
game: We may think of the game as played with a set of n cells or boxes 
indexed i = i, ..., n. 

Move 1; Player I 'hides* in a cell. 

Move 2: Player II, ignorant of I’s choice, attempts to 

•find' player I by similarly choosing a cell. 

This is a play. The payoff is determined by a set of 
(positive). If player I is 'found* in cell 1, he pays player II the 
amount cL^^; otherwise he pays 0. 

What are the optimal strategies for I? Let his strategy be to 
choose cell 1 with probability x^. Then player II will obtain expected 
payoff by choosing i. Hence he will chooso a cell i for which 

*^1^1 maximum. The value for him will thus be max . 

Now let X = (x^) be optimal for I. Assume that an 
dLjXj < max (<^j.Xj^) . Choose £ > o such that dj (Xj + 2) = max . 


= X . + £ for i - j 
J 

= x^ otherwise 


Then max 


max (cL.x^), 
i ^ ^ 


and 2^^ x| 

xr = —— 

^ 1 + £ 


V 

^i 


Xi + £ 


+ £. Hence th< 


can be used as probabilities, and 

max 

max (d.xlM = — -< max (eL.x,) , 

i ^ ^ i+£ i ^ ^ 

i.e., X = was not optimal. Thus necessarily all <L-x^ ~ max (®tj[X^), 

i.e., d^x^ = ... - d^x^ = A. Now Xj^ = 1 Implies A - 1/;;^;^ 5 ^- , 

and, of course, x^ = ^ . The value of the game (for II) is clearly A. 

^ 1 

We now Introduce the game in which our particular Interest lies. 
We call it the 2- dimensional game; it is a generalization of the 1-dimen¬ 
sional game as follows; 

The cells are doubly indexed from 1 to n. ^They may be thoughi 
of as fields in an n x n matrix.) 

Move 1; Player I hides as before. 

Move 2; Player II now attempts to 'find* I by guessing 

either of the indices of the cell in which player 
I has liidden. 

He must state which index he is guessing. (I.e., II attempts to pick the 
row, or the column, of I.) Player I, if so 'found' in cell i,j pays to 
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II the amount where the are a given set of positive numbers; 

otherwise he pays o. 

Thus player I has n^ pure strategies and player II has 2n. 

We now discuss optimal strategies for player I. Let his mixed 
strategy be x = = 1, where each x^^ represents the 

probability of his hiding in cell 1, j. Then player II *s pure strategies 
will give a return of for row choice i, or 

for column choice j. As in the l-dimensional game, he can now simply play 
pure strategies giving the maximum such return. Player I will try to 
choose X minimising this return. Thus the value of the game (for II) 
will be; 

The characterization of I's strategies is not quite as easy as before. The 
simple direct compensatory adjustment of the 1-almenslonal game cannot be 
made. 

For further progress, we obtain certain results on the geometry 
of convex bodies. 

We define: 

R = Set of all vectors z = (in n^ dimensions), 

such that 

"ij ^ "ij 

S = Set of all vectors z 
such that 

T = Set of all vectors z = dimen¬ 

sions), such that z^j = <r p for some permutation P 
of the integers 1, n^" (T thus consists of the 

n X n permutation matrices.) 

We prove two lemmas; 

LEMMA. 1 . S - Set of all z such tliat z ^ some 
w G R. 


“ ’ ' . = 1 . 

p 

= (z^j) (in n dimensions). 


PROOF. S 2 this set is immediate. 
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S C this set Is shown as follows; For any z G S let N(z) be 

^ 1 plus the number of all j with 
s 0, 1, 2, ... and R Is the set of those 


the niomber of all 1 with 
2i ^ 1 ‘ Clearly N(z) 
z e S for which N(z) * 0. 

Now consider a z G S. 
Sj z^j < 1 for some 1, or 


If z $ R, then there Is either 
S 4 ^ some j. However, all 

X] 2^5 ^ 1 , all Si Zij i 1. and^ 2:i( Sj-z^) “ Sj(Si ^ij) • Hence 

^'1 ^ ^ ^ iJiplles ZjLj < 1 for some 

versely. Therefore both z^j < 1 for some 1, say 

< 1 for some j, say j = j*- Choose 


^1 z 


j, ^d con- 
1=1', and 


ij 


e = 1 


Max 


( 2 , 


j *i'J 


’'ij- ) 


Then E > 0. Define 


Zj^, j, + £ for 1=1* , j =- j‘ 
otherwise 


Then z* = (z*^j) G S, also always ^ , l-e., z ^ z*; ana 

either zj^.j =1 or = ■•• Hence N(z) > N(z*). 

Iterating this process gives a sequence z<z’<z'’<... in 
S with N(z) > N(z‘) > N(z'') > ..., which therefore must terminate. It 
can only terminate with a z^“^ G R. Hence w = has all desired 

properties. 


LEMMA 2 . R = Convex of T. 

(This theorem is due to G. Birkhoff, Rev. Univ. Nac. Tacuman, 
Series A, Vol- 5 [19^6], pp. 147-148. Cf. also G. Birkhoff, "Lattice 
Theory," Revised Ealtlon, Amer. Math. Soc. Coll. Series, Vol. 25 [19^8], 
example 4* on p. 266 . The proof that follows Is more direct than 
Birkhoff's.) 

PROOF. R Is clearly convex. R Is Immediate. Hence 

R 5 Convex T. 

R C Convex T is demonstrated, if it Is established, that all 
extreme points of the convex R belong to T. Actually they form pre¬ 
cisely the set T. 

That every point of T Is an extreme point of R Is clear: 

A z G T belongs to R, and If It were not extreme, then z = 
tz' + (1 - t)z*’ with z*, z'' G R; z* ^ z* *; 0 < t < 1. Choose 
z|j ^ z|^., say zjj < z|*.. Then = tz|j + (1 - t)zj^'., hence 

< Zj^j < z|^.. Now either z^^ = 0 , implying z^j < 0 , or z^j = 1, 
iit 5 )lylng z|^. > 1 -- and both are iiipossible. 
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There remains, therefore, only this; To prove that every extreme 
point of R belongs to T. This Is shown as follows; 

For a z G R call a pair 1, j Inner , If ^0, l . Clearly 

z G T (for a z G R) means that all z^j = o, i, l.e., that no l,j Is 

Inner. Hence z $ T means that Inner l,j exist. 

If a line 1 (or a column j) contains at most one Inner 
element z^y then z^j = i - Xy z^y (or = l - Xy is 

necessarily * if o, -l, -2, ... . Since > o, therefore z^j ~ o, i, 

1. e., l,j Is not Inner either. In other words; If 1, j is Inner, then 

there exists an Inner l,j» (l',j) with j* j (!• ^ 1). 

Now consider a z G R, such that z $ T. Let 1,j be Inner. 

Choose j' ^ j such that i,j’ Is Inner, then 1* 1 such that l*,j* 

Is Inner, then J'* ^ J' such that l',j** Is Inner, then 1» * ^ 1* such 
that l*',j'' Is Inner, etc. In this way two sequences 1, 1', 1*», ... 
and j, j', j", ... arise, such that is Inner, i(“>), j(jn+l) 

la inner, and 1^"^ ^ ^(in+l)^ j(in) ^ j(in+1) m = 0, 1, 

2, ... ). Hence 1^^^ = 1^^^ or must occ\ar sometime for 

p q. Choose such a pair with p < q, and with q as small as possible, 
and with p (for this q) as large as possible. Hence 1^^^, 1^^"^^^ 
i(Q-i), j^(q) are pairwise different, also 

are pairwise different, with the possible exception of 1^^^ = 1^^^ or 
(or both). For ~ define 1^ = 1^^^, j’ = 

(= 1, = j, = .iq_p., = \ jq.p., = 

j(q-1)_ ppj, j.(p) ^ hence necessarily 1^^^ = 1^*^ , define 

1 = i(P) (= i<‘<3)i i = i(‘3) i =i(P+l) i = i(P+l) 1 

Iq - 1 1 >> io i . i] 1 . J, - J , ^q_p.i 

jq_p_i “ Thus two sequences 1^^, 1,, ..., ig_^ and 

jo» •••» 4-1 (s = Q - P> also define arise, with the 

following properties; 1^, l.j, ..., lg_.| are pairwise different, also 

Jo' J’l' •••' J’s-i are pairwise different, i^,j^ Is inner, Is 

is inner (all this for t^O, 1,..., s-1). l.e., the quantities 


(1) Zl 1 . Zl 1 . • 

■^oJo -^iJl 

''> i ' 

■^3-1 Js-l 


(2) Z, , , Z. , , . 

J-qJ, J-iJg 

3-1 *'3 

(jg “ Jq) 


are all > 0, < l . 

Now let £ be the minimum of the quantities in the lines (l), 
(2). Then £> 0. Define z' = (z£j) and z*’ = follows: 





+ £ (z., - e) 

- t (.J . o 


for the l,j of line (l) 
for the l,j of line (2) 
otherwise 


Then z’ G R and z'* G R are readily verified. Also clearly z* j4 z** 
and z « z ’ + ^ z ’ •. 
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Hence z is not an extreme point in R, q.e.d. 


We now return to the 2 - dimensional game and a characterization of 
player I*s optimal strategies- Let x == optimal strategy and 

let A be the value of the game (for player II) . We define 


^ - ^i.1^iJ 

""ij A 


(Zi-) . 


CXo&ply dXl ^ ^ fiilX ^ 1»6* j QiXX 


^1 ^ij ^ ^' Hence z = belongs to 


^ j j ^ ^ 

Now Lemma 1 implies the existence of a w = (Wj, j) belonging to 
R, with z ^ w- Form 


Then all 
hence 


i “ij 




all ''ij ” = A w 

= A. Also hei 

u^j.: Hence < Z.j ® = -ij ^Ij < ’• ’ 

Ou^ .. 


Ij 
hence 

Put 


= A, 


i j ’ V- V- 

Then x^j = i-e., the V 4 ,• can be used as 


ij 


probabilities, like the x^^-. Also Max (Sj '*‘i'j^i'j^ ^l®^ij'^ij»^ ~ 

i > J 

9A. If 9 < 1, then this contradicts the optimality of x - (x^^j) - Hence 
^ " - Since X. . <C U:, this iirplies 


e=i, l.e., = 


*lj " ''ij’ 


l.e., z^. - w^j. 


'Ij ''ij’ 


Hence 


Now Lemma 2 implies that z 
points of T. l.e.. 


"ij ^ "ij' 

5 = w G R. 

is the center of gravity of certain 


z = 2 t z"^ , z"^ G T , 

—»y y. 

The t = 0 may be omitted, l.e., t 


2 t = 1 


> 0 


> 0 niay be assumed. Form 


*^1.1 ^l.i 


X-- = Ulj.) 


Tnen the qptjjnality of x Implies that one of all x^'. Also z^. = J* 


for a suitable permutation P’^. Hence 


.j 




ij 


,j 


In other words; All optimal strategies are centers of gravity of 
optimal strategies of the special form 
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(*) 


X. . = ^ ^ (Pa permutation) 

Ij r,j 


Consider, therefore, the strategies of the form (*) • For such a 
strategy all ^ Si ^^'ij^ij * Hence 


) = ^ • 


Hence the optimal ones among these strategies are those that give the 
minimum A. 


^1 ^ 


to 


i,i^ 


Now, since the are probabilities, x^j == i, i.e., 

— = 1, i.e., A = l/!Si — * Hence the minimum A corresponds 

P , , 


the maximum 


wi -a- 


i,i" 


I.e., precisely those permutations P 


give the optimal strategies 
its maximum value. 

To sum up; 


l,r 


in question, for which 


V 1 

1,1^ 


assumes 


THEOREM. The extreme optimal strategies (i.e., 
those, of which all others are centers of gravity) of 
the 2- dimensional game are precisely the following ones: 
Consider those permutations P which maximize 




1 



For each P of this class form the strategy x = (^ij) 
according to (*) above.- 


Note, that this means that player I plays only those cells where 
the permutation matrix (of P) has a 1. (Here line guesses (1) and 
column guesses (j) correspond to each other equivalently under the rela¬ 
tion j = i^.) His play among these cells is then determined by the 
1- dimensional game 


The condition expressed in the above Theorem for P is exactly 
the optimal assignment problem with where the a^j are the 

elements of the assignment matrix (which, we saw, could be considered as 
all positive). 

Several further remarks can be made. 

1) A transformation of ^i ^j 

assignment matrix leaves the solution unchanged, and hence the game will 
be invariant (in its P's) under the corresponding 
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*lj > 1 + + Vj) • 

That the game should be so Invariant Is not at all clear Initially from the 
game Itself. (Note, this is not con5)lete Invariance. The 1 - dimensional 
solutions for a particular P may change, though the P remains the 
same.) 

2) Various extensions of the optimum assignment problem are 
possible and can be settled In essentially the same manner. Thus one can 
specify certain many-to-many assignment patterns between persons and jobs, 
and the like. 

In addition, certain formal generalizations of the game are 
possible — to various k- dlmenslonal forms with k « 5, ••• • These 

seem to be interesting, but present serious difficulties. 


J. von Neumann 


The Institute for Advanced Study 



TWO VARIANTS OP POKER’ 

D. B- Gillies, J. P. Mayberry, ana J. von Neumann 
INTRODUCTION 

Although the mlnimax theorem for zero-sum two-person games asserts 
that there always exist good strategies for such games, their calculation 
may be a most formidable problem. Methods for simplifying this problem are 
certainly necessary II' the complex games which simulate economic situations 
are to be attacked. In "The Theory of Games and Economic Behavior" (here¬ 
after designated as [ 1 ], in accordance with the bibliography at the end of 
this paper) several Idealizations of actual games of Poker are discussed, 
complete solutions are given to two of them, and some information is given 
about the solutions to others. This paper supplements that discussion 
with the solutions of two of the other variants mentioned there. Part I 
deals with the discrete case of sections 19 . 4 - 19.6 of [1] while Part II 
completes the discussion of the continuous variant of section 19 . 13 . 


PART I 

^ 1 . DESCRIPTION OP THE GAME 

We deal with the game treated in [1], sections 19 . 4 - 19 . 6 , pp, 190 - 
196 . The players v and 2 each obtain by a chance device a "hand," (i.e., 
an integer from among 1, 2 , ..., S); for either player, each of these 
hands is to have equal probability. Independently of the opponent*s hand. 
Then each player, being Informed of his own hand but not of his opponent’s, 
elects to bet either the amount a (the high bet) or the amount b (the 
low bet), where a > b > 0 . If both bet a [both bet b], the holder of 
the higher hand (larger Integer) receives the amount a [the amount b] 


^Editors* Note: This is a supplement to THE THEORY OP GAMES AND ECONOMIC 
BEHAVIOR, pp. 186-219 (as promised in a footnote on page 196 ) . It was pre¬ 
pared under Office of Naval Research sponsorship by D. Gillies (Part II) 
and J. P. Mayberry (Part I) from notes of Professor von Neumann, with his 
advice and collaboration. 
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from his opponent) (If the hands are equal, no payment is made). If one has 
bet high and the other low, the latter may choose either to "see,” or to 
"pass.” If he chooses to see, payment is made as if both had bet high 
originally; if he chooses to pass, he must forfeit the sum b, regardless 
of the hands held. 

For any s with s = 1, ..., S the player has three strategic 

choices, described by a numerical index ig = i, 2, 3; Ig ** 1 meaning a 

"high" bid; Ig == 2 meaning a "low" bid with subsequent "seeing" (if the 

occasion arises); Ig * 3 meaning a "low" bid with subsequent "passing" 

(if the occasion arises). Thus the (pure) strategy is a specification of 

such an index i„ for every s=l, ..., S — l.e., of the sequence 
s 

» • • •» • 

This applies to both players. Accordingly we shall denote the 
above strategy by Sid-i* •••> %) player i, and a corresponding one 

by 22 (^ 1 ' •••> for player 2. 

i 2 . lEPINITIONS 

Mixed strategies are Introduced as in [i], pp. 192 - 19 ^. I.e.> 

Instead of introducing a separate probability ... i f'li ... l-^ 

1 * * ’ S 1 s 

player I's [player 2's] using the pure strategy • • • %) 

••• Ig)]* ib suffices to use the probabilities />® [ 0 -^] for 
player l *s [player 2 ' 3 ] choosing ig =* 1 when Ills hand is s -- and, of 
course, doing this for each s - 1, ..., S. These probability-systems are 
then subject to the conditions [tr®^o] for all s,i, and 

2^ /’f “ 1 [ «■! = 1 ] for all s. ^ 

If players l and 2 use the mixed strategies P = (p^) and 
(T = ((T^), then the expected payoff of the game is the Yi{p\fr) of formula 
(19:6) in [1], p. 195 (there designated K(?\ ..., •••» t ))• 

Clearly (cf. also (19:7) in [i], p. 195) 

(2.1) K((»|»-) = i 

where s it^iP) is the ejected payoff for player l of his strategy p 
against player 2's actual hand s and actual choice ig =*= i» Equations 
(19;9:a) - (I9:9:c) in [1], p.l96 — or, alternatively, a common sense 
evaluation of the meaning of the y® — state 

(2.2.a) yf = g I ■ ^<“3^ ■ ^^3 * ^^2 ~ | ' 

(2.2.b) y| = ^ j ^ I ' 
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(2.2.0 ^ j - ^'’2 - j • 

Since the game is symmetric, a strategy ^ Is good If and only 
If It Is optimal against Itself (cf. [l], top of p.l95), 1-e., If 

( 2 . 3 ) K(/^|<r) ass-umes Its r-mlnlmum at (T ~ P • 

In view of (2.1), and of the domain of variability of the cr®, ( 2 . 3 ) can 
also be stated like this (cf. also ( 19 :A) in [1], p. 196 ); 

(2.l^) > ’fj Implies /»i = 0 (for all s,l,j) . 

Because of the symmetry K(/>,/>) = 0, hence ( 2 . 3 ) means that 

min KiP\<r) = 0. Again, because of K{P\P) = 0, this is equivalent to 

K(/»|(r) > 0 for all cr. Owing to ( 2 . 1 ), this can also be stated like this; 

( 2 . 5 ) ^ 3*^1 (for all 1,, Ig) . 

S ”” 

PLAN OF ATTACK 

In (4) we show that there exist strategies /»= (p^) where all 
/>! = 0 . We direct our attention to their aiscovery. 

In ( 5 ) we establish a characterization for good strategies among 
the ones to which we are now limited — where all ~ 0, l.e., where the 

choice is restricted to 1« = 1, 3 • 

O 

In (6) we obtain a rather specialized, but still somewhat re¬ 
dundant, normal form for these strategies. In terms of certain parameters 
P,Q (= 1 , .... S) and £(> - 1, < 1), 7y(^ 0, < 1) . 

In (T), (8) this normal form is discussed and specialized further, 
until an actual catalogue of all good strategies (as restricted in (i^), 
cf. above) is established In (8). 

In (9) the restriction of (4) Is reconsidered. 

In (10), (11) certain general Interpretive conclusions are 

drawn. 

j 4. PROOF THAT THERE EXIST GOOD STRATEGIES WITH ALL pi ^ 0 

Suppose we have a good strategy P - (P^), in which some > 0. 
Let s* be the largest such s, l.e., pi* > 0 and pI - 0 for s > s*. 
By ( 2 . 2 .a), (2.2.b) with s = s*, there results y®* > jf®* if ever 
pI y 0 for s < s* or ever /*® > 0 for s > s*. By (2.4) y®* > y®* 
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Iniplles = 0 , which is not the case. Hence necessarily /*2 ® ® 
s < s* — and, since this is the case for s > s , too (cf. above), 
therefore = o for s ^ s* — and = 0 for s > s*. S-uniraarizing: 


If ^ occurs at all, then it occurs for precisely 

^ * s 

one s, say s = s . In this case = 0 for 

s < s*; /o® = 0 for s = s*; - o (hence 

/>® = 1 ) for s > s*. 


Next define ^ as follows; 


(i^.2) 


^i 


= 0 




for s == s , 1 = 1 , 
for 3 = 3 *, i = 2 , 
otherwise. 


(Note, that = o [cf. (4.1)] implies, that actually = 1 , 

p|*= = 0 .) Let this substitution take into Now (2. 2 .a) - 

( 2 . 2 .c) give ^ for all s,i, except for s > s*, i = 2 , and in 
this case ?2 i I-e., for every s and ig there exists a jg, such 
that ?? > . Hence the validity of ( 2 , 5 ) for P (i-e., the y) im- 

plies its validity for P (i-e., the ?) — i.e., the goodness of P 

implies that one of P- Summarizing: 


r If /* is a good strategy according to (4.1) (i.e., with 
(4.5) J P^y 0 ), then the P of ( 5 - 2 ) (which has all p^ = 0 ) 
is also a good strategy. 

Thus the statement in the title of (4) is correct. Accordingly, 
throughout ( 5 ) - ( 8 ), P = (p^) will be assumed to be a strategy with all 
^ 1 = 0 , and its goodness wilx be the subject of the investigation. 

^ 5 - ALGEBRAIC CRITERIA FOR GOOD STRATEGIES 

Consider the criterlum of goodness (2.4). Since P 2 ^ 
need not be applied for i = 2 . Consider now j* = 2 . ( 2 . 2 .a), ( 2 . 2 .b) 
show that always • Hence the case 1=1, j = 2 need not be 

considered. The above also Implies y® - ^ “ ^^ 2 * Hence the case 

1 = 5 , j = 2 is disposed of if the case i = 3, j = 1 is. Thus there 
remain only the cases with 1 , j 2 , i.e., i = 1 , j‘ = 3 and 1 = 3 , 
j = 1 . These cases state, that y® > y® implies = 0 , and that 
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Put 


S /yS ySv 


y® < y® In5)lle3 /», = o, l.e., = i 

( 5.1 ) 

Tlieri these conditions become 

u® > 0 implies 

u® < 0 implies 


(5.2) 






0 . 


Thus the goodness of P is expressed by ( 5 . 2 ). 

Next, ( 2 .2. a), (2.2.C) give 

'’f * & <f? * fV * St>. (- SI • 5 II ^5) 

Since (Oj = 1 - > this becomes 


(5.3) 


St<a -St>s (2(S - s) . 1) 


Prom ( 5 . 3 ) 
(5.4) 


3+1 



+ P 


s+l 

1 


2b 

a+b 


^ 6. DERIVATION OP THE BASIC STRUCTURAL PROPERTIES 

( 5 . 3 ) yields u^ > 0 , hence by ( 5 . 2 ) p^ = ]. 

If = 1 (for some s=:l, ...,S-1), then (5*2) gives 
u® Xo, ( 5 . 3 ) gives u®*^^ - u® > 0 , hence u®’*'^ > 0 , and so by (6.2) 

(^f= 1 . 

Thus s with = 1 exist (e.g., s = S), and if s = R is 
the smallest one, then s = R + 1, ..., S, too, belong to this class. 
Hence they are precisely s=R, R+l, ...,S: 


( 6 . 1 ) 


{ 


= 1 occurs precisely for 
is a suitable number = l, . 


s 


= R, R + 1, 

S. 


S, where R 


Por s = l, ...,R-l P^ 7^ ^» hence by (5-2) < 0* It 

is therefore of Interest to determine those s=l, ...,R- 1 , for which 
u® = 0 . Let 3 / be the set of these s. 

Consider an s G 3 /. Assume s - 1 t ^ (s 5 ^ 1 ). Then u® « 0 , 
u^“^ < 0 (cf. above), hence P^~^ “ ® (^y 5*2) and u® - > 0, 
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hence > 0 (J-**)), i-e., />® > . Hence 

/>® + - u® > 0 (hy (5••^)), u®'^’ > 0, z*®*’ = 1 

(by (5*2)). Hence s + l > R, and since s < R - l, this gives 
s = R - 1 . Thus s G ji/ implies s-IGj/if sji^R-l (and s ^ 1). 

Now let P be the largest number among 0, l, ...,R-1, such 
that all 3=1, ..., P belong to j/. Then, according to the above, j/ 
consists of the s = 1, .. , P, and possibly s = R- l. If P=R-1, 

then the addendum s = R - 1 is not needed; if P = R - 2, then the 

addendum s = R - 1 would require P = R - 1. I.e., this addendum can 
only occur for P ^ R - 2, R - l. 

1 2 

Assume ? 0 and R ^ 1, 2. Then u^ = o, u^ < 0, hence 

" ^1 i ~ i+E S ° (5.4)), hence /», < ^ . Also 

f>\ > 0, hence pi = (i + £) with - ’ < £ < 1 • Next, let 

s, s + 1 = 1. .... P. Then u® = u®*’ = o, u® = o, l.e., 

/>® + = 0 (by 5-4)), hence />®‘^’ = ^ • Summarizing: 


( 6 . 2 ) 


r 


< 


If ? 0 and R ^ 1, 2, then there exists an ^ 

with - 1 < £ < 1> such that for s = 1, ..., P 


V. 


= iTE 


- £) for s 


(Odd ) 

(even} * 


Next, assume ? 0 and R = 1, 2. This means P = 1, R = 2. 

If ff < » then > 0 gives ^ (l + 6) with - i < £ < 1, 

i.e., (6.2) still applies. If » we redefine P : P = o, and 

view s = 1 = R - 1 as the addendum referred to above. Thus this addendum, 
s = R - 1, has at any rate . Also < 1, hence = 1 - 

1=1 »j with 0 < 7| < 1 . 

Finally, for P = o (6.2) is vacuous. 

Summarizing: 


(6.3) 


^ For s = 1, .. •, R - 1 necessarily u® < 0. Let 

S» g 

be the set of all s = 1, ..., R - 1 with u = o. 
The elements of j/ can be represented in this way; 


(a) All s = 1, ..., P. 

(b) Possibly s = R - 1. 

J P is a certain number =0, l, ..., R - 1. If (b) oc¬ 
curs, then P ^ R - 2, R - 1, exc^t that P = 1 , 

R = 2 is not excluded. The for s G »/ are rep¬ 

resented as follows: 

(a) There exists a fixed £ with - 1 < £ < 1, 
such that for s = 1, ..., P 
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(6.3) 




- £) for 8 




There exists a fixed Y| with o < >j’ < i, 
such that for s = R - i (if the case (b) 
arises) 






a-b ^ 

*1 


The case (b) can be made to arise with certainty, by doing this: 
If case (b) does not arise, replace R by R + l, and say tliat (b) has 
arisen with t] = o. 

The set of all s = l, ..., R - 1 not In j/ consists now pre¬ 
cisely of the s=P+ 1 , R- 2 . Put Q = R- P- 2 = o, i, ..., 

then these are the s=P+l, ...,P+Q. For these ( 5 . 2 ) gives (this was 
used earlier) = 0 . I.e.: 

(6.4) For s=*=P+l, ...,P + Q always *= 0 . 


Combining ( 6 . 1 ), the revised form of ( 6 . 5 ), the definition of Q, 
and (6.4) we can summarize as follows: 


( 6 . 5 ) 


The basic parameters of a solution are these: P, Q, £, 
They are subject to these conditions; 

P, Q = 0, 1,2, ... ; 5 2 P + Q + 1 ; 

- 1<£<1 ; 0<»|<1 

P 7 ^ 0, Q == 0 imply 7 | = 0 . 

They determine the (s = 1 , ..., 5) In this way: 




r 


^ (1 1 £) for 3 , and s = i, .... P , 




for s = P+i, ...,P + Q, 


a-b 


s=P + Q+ i, 


for s = P + Q+ 2 , ..., S 


Note, that y/ now consists of the s = 1 , ..., p, and. If 
Tj ^ 0 , also s *= P + Q + 1 . 
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f 7 . ALGEBRAIC CRITERIA FOR GOOD STRATEGIES (CONTINUED) 

We caxi now determine all good strategies (in the sense of the re¬ 
mark at the end of (4)), by applying ( 5 - 2 ) to ( 6 . 5 ). We will also check 
that u® == 0 for all s G i/, in the sense of the definition of 

These conditions must hold for all s = 1 , S. We deal with 

these in three segments: 

3 = 1 , P: These belong to j/, hence we must require 

u^ = ... = u^ = 0 . This satisfies ( 5 . 2 ). By (5-4) - u® = 0 for 

s=l, ..., P - 1 , i.e., u^ ~ ... =u^ automatically. Hence the only 
condition that we need to state is 

( 7 . 1 ) u^=o if P^o. 

s = p+l,...,P + Q: ( 5 . 2 ) requires ^ 0 for s = P + l, 

P + Q. By ( 5 . 4 ) u^’*’^ - u^ < 0 for s = P (if P^o),P+1, ..., 

P f Q - 1 , hence ^ (If' P / 0) and ^ ^ The 

above requirement is therefore vacuous, if Q = O; it lollows from u - o, 
which is a consequence of (7.i) (and of u^ =* ... u^, cf. above), if 

P^O, Q^O; it would follow from u^^^ i.e., u ^ 0 ^ 

P = 0, Q 0 . Hence the only condition that we need to state is 

(7.2) u^ < 0 if P = 0 , Q 0 . 

s^P + Q+ l,...,S: S“P + Q+1 belongs to j/ if Tj ^ 0, 
hence we must require u^ = 0 in this case. This satisfies ( 5 . 2 ). If 
T| = 0 , then ( 5 . 2 ) requires u^ > 0 in this case. I.e., 

( 7 . 3 ) >0 with = if > 1?^0 ’ 

( 5 . 2 ) requires u^^o for s = P + Q+ 2, ...,S. By (5-4) u -u ^0 
for s = P + Q + 1 , S - 1 , i.e., < ... < u^. Hence the above 

condition is automatically satisfied owing to (7-3). 

Thus ( 7 . 1 ) - (7*3) are a con 5 )lete characterization for good 

strategies. 

Now (5-3) gives for P (^enl * 

u' - iti) - 1 

- (S - P - Q - 1) + sib 
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with these additional observations: For P = Q = o this case is imma¬ 
terial. For P == 0 , Q 0 , the - (P - i - (g)) -terra in the first 
form of the right hand side above should be omitted. This is best achieved 
by putting £ = - 1 in this case. 

Next, (5-3) gives for P {gyen} : 

(P " 

-(S-P-Q-1)+^ (2(3 - p . Q - 1) + 1) 

s<~b rt 8 «~b ^ a -n , b f£ 1 . a 

a+b a+b ^ a+b ^ a+b a+b ’ 

Hence (7. l), ( 7 . 2 ) can be stated like this: 

for P {even! ' P o; with £ = - 1 If P = o, 

Q ^ 0; with the condition omitted if P = Q = o. 

;an be stated like this: 
p>^s-SzkQ.k(§) 

P fev^ « ''“h = If 7} ^ 0 . 
i 8 . CATALOGUE OP GOOD STRATEGIES 

(T.**), ( 7 - 5 ) characterize the good strategies. It Is convenient 
to restate them with the aid of the quantity 


(7.3) 

(7-5) -i 


(8.1) L = P + Q 

In place of P. The statements of (6.5) concerning P,Q now become 

(8.2) L = 0, 1, ..., S - 1 ; Q = 0 , 1 , ..., L . 

(7.‘7), ( 7 - 5 ) become: 


^<^S-|(Q+ (?)) - ^ 1] 


lC.5) 


for L - Q ; with = If L Q ; with t = - 1 If 

L = Q ^ 0 ; with the condition omitted if L = Q = 0 . 
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f l.> S + I (Q - [§)) - 1 
L for L-Q{°^y ; with - If if ^ o . 

It is now convenient to distinguish four cases; 

I; L « 0 — l.e., P « Q * 0: 

(8.5) is omitted, (8.4) becomes o > S - 1, l.e., 

(8-5) S < 5^ • 


Thus (8.5) characterizes this case. 

II: L = Q 0 — l.e., P = o, Q ^ 0: 

( 8 . 3 ) becomes 

L< - I (L - 1 ) - ^ »1 . 

i.e. 

T / a-b « . b a~b ^ 

(8.4) becomes 

L> + |l - 1 . 

l.e. 

^ ^ ® " a?b ' 


with = 

if Hfio. 

Hence necessarily 


I 

r 


( 8 . 6 ) 



V — a 






and if these inequalities are fulfilled, then the original ones are, too, 
with H = 0 . 

Thus ( 8 . 6 ) (for an L = 1, 2, ••• ) characterizes this case. 

Note, that if an L according to ( 8 . 6 ) exists at all, it is 
unique. Indeed, the opposite would require that the length of the Interval 
of ( 8 . 6 ) be > 1 . This means 


a-b 


which gives S < . Then the first relation of ( 8 . 6 ) gives L < 1 
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hence no solution other than L = 1 exists. 

Note further, that (8.6) necessitates 


a-b 

a+b 


S + 


D J 

a+b 1 


> s - 


a-b 


> 1 


l.e. 

(8.7) 


a^ + gab - b^ 


a /ay a + tiELP - i 
i-b i ^ 2b(a - b) 


III: l,fiCl=0 — l.e., P 0, Q = 0: 

(8.3) becomes: 


L = ^ S - I (0) 


a-b ^ 
“ 1 


for L 


yodd I 
I even] 


(8.4) becomes 


L ^ ^ s -1 ’ ' 


fop L , with = for n^o. 

The proviso made In ( 6 . 5 ) refers to this case and Inplies *r|= 0 . 
Consequently we have the conditions 


for L ] . 

levenj 

( 8 . 8 ) 


L = ^ S - I (i) , 

L > S - ^ (S) - 1 , 


For an odd L the first condition becomes 


L = ^ S . 


while the second one is then automatically satisfied. For an even L the 
first condition becomes L = ^ " a ^ 


( 8 . 9 ) 


i s . L< 


and the second one is again automatically satisfied. 

Thus (8.8) (for an L= 1, 5, ••• ) or ( 8 . 9 ) (for an 
L = 2, 4, ... ) characterizes this case. 

Note, that if an L according to (8.8) or ( 8 . 9 ) exists at all, it 
is unique, because of ^<1 : If ( 8 . 8 ) gives an odd L, ( 8 . 9 ) cajindt 

81 
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contain an even L, and (8.9) cannot contain two different even L. 

IV: — l.e., P^O, Q^O: 

Since l, 2, therefore Q+ and Q- > 0 * 

Hence (8.3) implies L < S ana ( 9 -^) iii?)lies L > S - 1 . Hence 

(8.10) L = ^ S - K , 
where 

(8.11) ^S-K=2, 3,...; 0<K<1. 

Clearly (8.11) can be satisfied by a suitable K if and only if S 
i.e. 

(6.12) nBb- 

Also, the K of (8.11) is unique, unless S = 3, in which case 

K = 0 , 1 will GO. In this case, however, (8.8) (with L - 3 , 3 , ... ) or 
(8.9) (with L = 2, 4 , ... ) can be t^ilfilled. Hence we can ignore it. 

Now (8.3) becomes 

K = | (Q. (0,) , a^^ 

for L - Q ] . 

K ^ - I (Q - {§)) + 1 

for L - Q ; with = if i] ^ 0 . 

It is best to discuss (8.13), ( 8 .l 4 ) separately for t| = 0 and 
for 

>1 = 0 : (8.13) becomes 

(8.15) Q + (^) = § K for L - Q . 

( 8 . 14 ) becomes 

(8.16) (i - (§) < I (1 - K) for L - Q . 

Tj ^ 0 : Here 0 < rj < 1, and in view of this (8.13) becomes 




IlN/ 
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( 8 . 17 ) 


Q + J 


<ek 


a-b 


\ Cl IT a-D 

> F - T“ 


for L - Q \ . 
^ (even) 


( 8.1 if) becomes 

(8.18) Q.(«)=|(, _K) forL-Q(° 5 ^J 


The second relation in (8.17) can be translormeo by adding (8.18) to It. 
This gives 


2Q ^ £ > 1 . 

Since Q= 1 , 2 , ..., this Is always true, except when Q == 1 , £ = - 1 
for L • !•©•, the second relation in (8.17) can be replaced by 

forbidding this. 

Hence all these cases (expressed by (8.15), (8.16) for t[ = 0 
and by (8.17), (8.18) for ^ ^ 0 ) can be summarized as follows: 

Either Q+(^)«|k, Q-to^<§( 1 --K:), 

or Q + ( 2 ) < f K , Q - {§) = I (1 - K) , 

(8.19) < 

for L - Q (even) ’ second alternative, Q = 1 , 

£ = - 1 for L is excluded. 

The first alternative, with L - Q odd, requires that ^ K be 
an Integer, and of opposite parity to L. Then Q = ^ K, and 
Q - £ < ^ (1 - K) In addition. This is possible if and only if 

Q - 1 < § (1 - K) , I K - 1 < I (1 - K) , 

I.e.: This occurs when 

(8.20) I K is an Integer, of opposite parity to L, and K< . 

The second alternative, with L - Q even, requires that 
^ (1 - K) be an Integer, and of the same parity as L. The exclusion made 
there is Irrelevant, since the conditions that apply to this case cannot 



26 


GILLIES, MAYBERRY, VON NEUMANN 


force a choice fc * - 1. Then Q *= § (1 - K), and Q - g < ^ K in 
addition. This is possible if and only if 


Ci-1 <|K, |(1-K)-1<|K, 
z®* a*“b w v a~b 


I.e.; This occurs when 


( 6 . 21 ) 


I (1 - K) 


is an integer, of the same parity as L, and 


Assume, finally, that both of these cases do not take place, i.e., 
that the first alternative holds with L - Q even, or the second alterna¬ 
tive with L - Q odd. The excluded case ft = l, E = 1 can only be forced 
by the second alternative in ( 8 . 19 ) when K = 1. This possibility has the 
same consequences as the one considered immediately after (8.12). Hence 
the exclusion of ft « 1, E = 1 can be disregarded. 

In view of these remarks, ( 8 . 19 ) now becomes this: 


(8.22) J 


Either ft+E=§K,ft of the same parity as L, and 
ft<|(l-K), or ft-E=|(l-K),ft of opposite 
parity to L, and Q < | K • 


The first alternative means, that the smallest integer of the same 
parity as L, which is > § K - 1, is also < § (1 - K). I.e.: 


( 8 . 23 ) 


There exists an integer ft of the same parity as L, which is 
>|k-i and<|(i-K). 


The second alternative means, that the smallest integer of oppo¬ 
site parity to L, which is > | (1 - K) - l, is also < § K. I.e.: 


(8.2U) 


There exists an integer ft of opposite parity to 
<§K and >|(l-K)-1 . 


L, 


which is 


Adding 1 to the Integer referred to in ( 8 . 24 ), this assumes the following 
equivalent, form: 
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r There exists an integer Q + 1 of the same parity as L, which 
(8.25) i,- 

[ Is < I K + 1 and (1 - K) . 

Now let Q* be the unique integer of the parity of L, which is 

^ p K - 1 and < ^ K + 1. Then (25) is solved by ft if and only if this 

Is “ ft*, ft* + 2, ft* + If, ... and <1 (1 - K); and (25) is solved by ‘ 

ft + 1 if and only if this is = ft*,'ft* - 2, ft* - U, ... and ^ § (1 - K). 

The former is possible when ft* < | (1 - K)} the latter is possible when 

One more thing remains to be determined: Whether the ft accord¬ 
ing to ( 8 . 19 ) fulfills the requirements of ( 8 . 2 ) and ft L, i.e., whether 
ft < L. If this were not the case, there would be ft^ L in ( 8 . 19 ). Now 
by (8.4) 


L^^S + |(ft-l)-l , 


hence Q ^ L gives 


Q^^S + |(ft-i) -1 , 


and so 


s < ft + 


a+b 


^ • 


Adding the two relations of either alternative of (8.19) together, gives 

2ft + {‘I) < I , 

I.e. 


2ft - 1 < t , 



Hence 



In other words: 


(8.26) 


s > 


suffices to guarantee ft< L — i.e., the requirements of (8.2) and ft ^ L. 
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Note, that (8.26) implies (8.12). 

^ 9. REMARKS CONCERNING GOOD STRATEGIES WHERE OCCURS 

Consider a good strategy ^ where ^2^^ occurs, i^ply 

(1^.1) « ( 4 . 5 ), and form, in particular, the good strategy (f®) re¬ 

ferred to there. For this always * 0, and (5) - ( 8 ) apply to it. The 
quantities and concepts that were introduced in (5) - ( 8 ) should therefore 
he understood in the balance of this section as referring to (and not 

to /O) . 

Consider the s of ( 4 . 1 ). According to the remark immediately 
following ( 4 . 2 ), 1 . Hence by (6.5) 

(9.1) s* > P + Q + 1 , with > for T| ^ 0 . 

It is easily seen, that the other Inferences that can be drawn from ( 4 . 5 ) 
(with ( 4 . 2 )) are automatically satisfied owing to ( 9 . 1 ). 

For any s* satisfying ( 9 - 1 ), = (p^) can be derived from 
F (^®) according to ( 4 . 2 ). Here /o®* can be chosen freely, subject 
only to 

* # 

(9.2) 0 < « 

all other are then determined. There remains the task to establish, 
which of the strategies P that obtain in this manner are good. This will 
not be undertaken here. 


f 10 . CONCLUDING REMARKS 


Prom the general existence proof (l-e., the mlnlmax theorem, 
cf. the reference at the beginning of the Introduction.) we know that good 
strategies must always exist — l.e., for all values of a,b (a > b )> 0) 
and of S(= 1, 2, ... ). 

Our present results, as formulated in (8) (together with ( 4 . 1 ) - 
(4.5), cf. (9) above), do not go quite as far in all cases, but what con¬ 
cerns us here, is the additional information that they give for most cases. 

To be specific: 

Put «»>= ^ -- hence 0 < to < 1 . 

a <1 

Case I (P = Q * 0) takes care precisely of the S < 

(cf. (8.5)). Case II (P = 0, Q ^ 0) takes care of certain 
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(cf. (8.7)), possessing certain special arithmetical properties (cf. (8.6)). 
Case III (i.e., P ^ 0, Q = 0) takes care of certain S (cf. (8.8), 

(8.9)) that form an unbounded set, which has an asynptotic density that is 
in general <1 (cf. below). Case IV takes care of certain S, that 
comprise all the S above a certain limit, namely all those 



(cf. (8.26)). 

Thus Cases III and IV represent the "general” solution, and IV 
usually more than III. To elaborate this further, note that IV conprises 
all the S above a certain size, while III as a rule does not. In this 
respect the two following observations are relevant; 

Regarding III: If w is irrational, then the set of (8.8) is 
empty, and the set of (8.9) has the asyiEptotic density w. If « is 
rational, with the (Irreducible) denominator n(= 2 , 3, ... ), then the 
set of (8.8) has the asyii5)totic density ^ , and the set of (8.9) has the 
asymptotic density w + ^ . Hence Case III has the total asymptotic 
density cj or ; respectively. This is <1, unless w is 

(rational and) = (n = 2, 5> ... ). 

Regarding IV: The actual value of S for Poker is 2,598,960 
2,6 X 10^ (cf. ( 1 )). Tills lies outside the domain of Case I (l.e., it 
is > j^) unless «>i-3.9xl0“^, it lies outside the domain of 
Case II (i.e., it is > ) unless <»>> i - 7.8 x 10“'^ or 

< 1.9 X 10"^. I.e., if we disregard altogether iriplausible and extreme 

values of cj - Case IV is valid, and Cases I, II are not. 

^ n . CONCLUDING REMARKS (CONTINUED) 

The observations of (10) justify oui- limiting our interpretations 
to the Cases III and IV of (8), with a special emphasis on Case IV. 

In both Cases III and IV values ^ 0, l occur (for 
1 = 1 , .... P there Is /»? = (’ - «). ( 6 - 5 ), remembering *» = | ), 

l.e., these are truly mixed strategies. Regarding their detailed properties, 
the following things can be said. 

Consider first the asyiqptotlc behavior, i.e., that for S —» 

-- this is, of course, approximately valid and typical for large S, e.g., 
for the "real" case S 2.6 x 10 ^ (cf. the end of ( 10 )). 

As observed Immediately before (8.26), L - P = Q la bounded 
and by (8.8), ( 8 . 9 ), ( 8 - 10 ) {1-<^)S-L is also bounded. 

Thus (1 - w) S - P and Q are both bounded, and therefore 
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(11.1) I —> 1 - w , I —> 0 . 

Hence the behavior of />®, for s = P+i, ...,P + Q is 
irrelevant. For s=P + Q+l, S For a = l, ..., P /»® 

alternates between the valuea (i - 6) (of. above), i.e., it fluctuates 

average is . 

Thus the mean behavior converges to the one determined in equa¬ 
tion (18.21) of [ 1 ], p. 202, for a continuum of hanas. This is unaffected 
by the possible introduction of the />| according to ( 4 ) and (9), since 
this affects only a single a (= s*). The mean referred to above may be 
taken for any s-interval whose length increases asymptotically propor¬ 
tionately to S, as S —y 00. 

On the other hand, the exact oscillation of the does not 

subside asymptotically, as S —■> <». Indeed, the oscillation of (in 
the domain a = i, ..., P, between neighboring values of s) is 

|£| (cf. above), and S —> oo does not imply £ —o. A specific 
inspection of Cases III and TV in (8) shows, that £ is very sensitively 
determined by the precise arithmetical relationships between a> (i.e., 
a,b) and S, and that it sweeps its entire domain quasl-perlodlcally, no 
matter how large S gets. 

Using a terminology that is familiar from function theory, one 
might say: as S —■> «, the good strategies of the dlscrete-hand-poker 
converge to those of the continuous-hand-poker in the sense of "weak" con¬ 
vergence only. This phenomenon is therefore heurlstlcally instructive, 
regarding what one should expect more generally, when a "continuous game" 
is investigated in detail in its relationship to the "discrete games" of 
which it might be viewed as a limiting case. 
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PART II 

i 1 . EESCRIPTION OP THE GAME 

The situation to be dealt with is described in "Theory of* Gemes^" 
section 19«13 (pp. 209-211); Each of two players receives a "hand," which is 
a randomly equidistributed number x in the Interval 0 < x < 1, and de¬ 
clares a bid ot in the Interval a^<<>b (a>b>o), ‘“this' declaration 
being made with the knowledge of his own hand, but in ignorance of his op¬ 
ponent's hand and bid. If the bids are of equal size, then the hands are 
compared, and the player with the weaker hand pays his opponent the amomt of 
the bid. If the bids are unequal, the player who has made the smaller bid 
pays this amount to his opponent. He has no option of "seeing" his opponent 
(i.e., of matching the bid), nor are hands conipared. 

There are two cases to consider: 

(I) All bids ci.. in a > ot > b are allowed. 

(II) Only a finite number of possible bids: 

a - a, > ag > ... > > a^ = b 

are allowed. 

The whole discussion that follows will be more informal, and in 
parts (2) and ( 4 ) more heuristic, than the discussions in "Theory of Games" 
or in the preceding paper. The definitely formulated conclusions and their 
proofs are, nevertheless, rigorous. 

4 2. CASE (I): A CONTINUUM OP ALLOWED BIDS 

2.1 . Let us analyze a potential good strategy -- since the game 
is symmetric, it does not matter for which player. 

Assume that for all hands x > x^, where x^ is a constant to be 
determined, the strategy provides always betting a, i.e., the hipest pos¬ 
sible bid. For the other bids dk» (i.e., a > of ^ b), let (|)(fl^.)ddL be the 
a priori probability (i.e., the one integrated over the random equldistrlbu- 
tlon of hands x) that «<* Is in the (infinitesimal) interval from dl to 
cC + do*.. 

Assume that for x < x^ the expected value of the game is the 
same for all choices of the bid <a*, if the opponent plays this strategy. 

The expected value in question is 

b^y [;/ $(o*,)d<i + (1 - Xq) J . 

ihe Independence from <*.• is best expressed by stating that the -de¬ 
rivative of this quantity is zero. This gives 
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( 2 . 1 . 2 ) SdJ ^ id ,') - 't'(«*)<iA+ (1 - Xq ) ] =0 

Another differentiation (and writing for ok*) gives 

+ 30(cA.) = 0 , 


i.e. 

whence 

( 2 . 1 . 5 ) 


-1 i 

>1) 2 el 


iKdL) = . 


Substituting ( 2 . 1 - 5 ) into (2.1.2) gives 


(2.1 .h) 


2ka - (1 - Xq) = 0 


The definition of (|)(dL) implies 

a 
b 


i.e. 


*/ 


(l)(cl)del + (1 - Xq) = 1 , 


7 


(l)(el)d<*. - Xq = 0 . 


Substituting (2.1. 3 ) gives 


( 2 - 1 - 5 ) 


2kb ^ - 2ka ^ - Xq = 0 


Prom (2 .l.k), ( 2 . 1 . 5 ) by addition 


2 kb ^ - 1 - 0 , k = 1 b^ , 


so that (2.1.3) becomes 

( 2 . 1 . 6 ) 

and then (from ( 2 . 1 . 4 )) 

i.e. 


(KdL) = i b^ , 


- (1 - Xq) = 0 , 


X - 1 - (k)2 , 

o a' 


( 2.1 . 7 ) 
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2.2. With the choices (2.1.6), ( 2 . 1 . 7 ), the e^spression (2.1.1) 
is independent of 6L.', hence its value for all xk' is the one that it has 

for oc' = b, which is obviously - b. I.e., for any hand x < and any 

bid cIl’ the expected value of the game is the sajne: - b. 

The expected value of the game is still given by the expression 
(2.1 .1) for a hand x < x^, provided that the bid ot* is < a. I.e., it 

is still - b in this case. For a hand x > x^ ana the bid oL* = a, 

however, (2.1.1) must be replaced by 

[ b ^ a(x - x^) J - a(l - x) . 

This expression has the x-derivative 2 a, and for x - x^ it goes over 
into (2.1.1) (with (k* = a), i.e., its value is then - b. Hence its 
general value is - b + 2a(x - x^). 

Summing up; 


( 2 . 2 . 1 ) 


^ The expected value of the game for the hand x and the 
^ bid ck (if the opponent plays the strategy under con- 
sioeration) is - b, except when x > x^, rf. = a, in 
^ which case it is - b + 2a(x - x^). 


2,3. (2.2.1) Itiplies this: In order that a strategy be optimal 

against the one considered above, it may allow any set of bids ck for hands 
X < Xq, but it must prescribe the (highest) bid oi = a exclusively for 
hands x > x^. 

The strategy considered above (i.e., the one introduced in ( 2 . 1 ), 
with the determinations ( 2 . 1 . 6 ), (2.1.7)) Itself fulfills this condition. 
Hence It is optimal against itself, i.e., it is a good .strategy. 

Note, that the definition of (2.1) actually allowed for a whole 
family of strategies, all of which, according to the above conclusion, are 
good. Indeed, for bids oL < a, only the a priori probability density 
(l)(dL) is specified, but not the conditional probability density (|)(ol,x), 
for a given value of the hand x. This, more detailed, structure of the 
bidding-rule has thus no influence on the goodness of the strategy. 

This phenomenon may seem strange, but it is quite understandable. 
All bids dk < a are (in these strategies) induced by probability densities, 
i.e., the probability of any one individual value bk < a is 0. Hence the 
probability for two opponents, whose bids ^^,^2 ^ 

to make (accidentally) equal bids = <*2* is also 0. It is in this case 
only, however, that their respective hands affect the outcome. 

In the case (II), where only a finite number of bids are possible, 
individual bid-values with non-0-probability will be the rule. In this case 
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the hand and the bid will therefore Interact substantially in determining 
good strategies, as will appear in the course of ( 3 ), especially in (3-3-2) 
and in the concluding section ( 3 - 9 ) • This will lead to very definite 
”flne structures” for good strategies, which can exhibit various peculiar 
oscillatory phenomena when the number m of possible strategies tends to «. 
These are in some ways analogous to the "weak convergence” phenomena for 
poker with a rinite number of hands, as discussed in the preceding paper. 

^ 3 . CASE (II) : A FINITE NUMBER m OP AliOWED BIDS 

3.1. Let us again analyze a potential good strategy — since the 
game is symmetric, it does not matter for which player. 

Let 9 y(x) be the probability of the bid a^ (v = 1 , ..., m) 
when the hand is x. Hence 

(3.1*1) QyM > 0 , ^ * 

The a priori probability of the bid ay is then 
( 3-1 -s) “ J* ’ 

of course 

( 5 - 1 . 3 ) ^ 0 , ' ■ 


Consider the expected value Ify(x) of the game for the hand x 
and the bid ay, if the opponent plays this strategy. Clearly 

(3.1 y^(x) = " %(- J/®v(y^^y) 

Prom ( 3 * 1 •^) 


(3-1-5) yy(x') - ry(x’') = 2 ay. e^(y)ciy - 


This makes it also clear, that is continuous in x. 

3.2. Prom this point on rigor requires the use of (Lebesgue-) 
measure theory. We will try to do this without disrupting the intuitive 
pattern of the deduction too badly. 

We call x a v-point, if for every open Interval I with 
X G I the y G I with 9 y(y) o have a measure ^ o. 

Let X' be a v-point, ana x'* < x’ not a v-point. The 
X ^ X* * which are v-points form a closea set This set contains x', 

hence it has a minimum element x*. The set does not contain x’’, hence 
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X* > X* * . Thus X* is a V-polnt, while no x in x* > x ^ x’ ' is a 

*v-point. By virtue of the usual covering theorems the y in x > y > x** 

with ©^(y) ^ 0 have measure o. 

^ * 

Consider an open Interval I with x G I. Then the y G I 

with 9 y(y) ^ 0 have measure ^ o. 

Consider an open sub-Interval J of the open interval 

X* > y > X' ’ . Then ( 3-1 - 1 ) implies the existence of a /x such that the 

y G J with ®^(y) ^ 0 have measure ^ 0. Hence /i y. 

Now the goodness of the opponent’s strategy excludes 

y^(y) > y^Cy) on a set with measure ^ 0 where e^Cy) j4 o, hence there 

exists a y G I with y^(y') < Similarly, it excludes 

Ify(y) Y (y) on a set with measure ^ 0 where ®^(y) 7^ hence there 

exists a ' G J with y (y*') > y^(y**)- 

Hence ^ 

° ' 
f*' y — r ^ 


therefore 


[yy) - yy)] - [yy) - ^^(y')] = 
[yjy) - yjy)] - [y (y) - yy)] < o , 

^ y ^ y - 


and so by (3 *1 * 5 ) 


(3.2.1) 


■;:/( 


a e (x) - 


a e 
V V 


(X)) 


dx < 0 


Now let I converge to x* and J to x'*. Then 
y' —•> X*, y' * —> X' ’ . 'v) niay vary, but some value of p. v) must 

be assumed Infinitely often in this convergent sequence. Restricting our¬ 
selves to this subsequence, we may assume jjL to be fixed. Hence (5.2.1) 
becomes 


(5.2.2) 2 . ^ J (a^y(x) - a^ 9 ^(x)^ dx < 0 . 

We saw above, that the y In x* > y ^ x'’ with ©^(y) ^ 0 have 
measure o. Hence (5*2.2) becomes 


2 • r a 6 (x)dx < 0 . r 6 (x)dx < 0 . 

I*. fL = tC'J = 

Owing to ( 5 * 1 . 1 ) this means, that the y in x > y > x'» with 0 ^(y) 0 

ss 

have measure 0. This contradicts the fact, that there exist open sub¬ 
intervals J of X* > y > X* ’, such that the y G J with 
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/ 0 have meaaiire 0. 

In view of this contradiction our original assuii5)tlon must have 
been wrong. I.e.: 

(3.2.3) ®' 'V-polnt, then every x'* < x* Is a 
V-point, too. 

Assume that v-polnts exist. They form a closed set, hence It 
has a maximum element of course 0 ^ 5v ^ ^ • If no v-polnts exist, 

put ly = 0. At any rate, no x In |y < x < 1 Is a v-polnt. By virtue 

of the usual covering theorems the x in fcy < x < 1 with e^(x) ^ o 
have measure o. In view of the two-way definition of | , at least 

every x in O < x < is a v-polnt. 

Now consider two x',x'* with 0 < x* ^ 0 < x'* < | . Con¬ 

sider two open Intervals I',I»* with x* G I', x" G I". Then the 
y G I* with ©y(y) ^ 0 have measure ^ o and tne y G I'* with 
©^(y) ^ 0 have measure ^ 0. The goodness of tne opponent’s strategy 
excludes y(y) > K^Cy) on a set with measure ^ o where ©^(y) ^ 0, 
hence there exists a y' G I’ with y^(y') < y^Cy*). Similarly, it ex¬ 
cludes iry(y) > y^(y) on a set with measure / o where ©^(y) o, hence 

there exists a y” G I” with yjy'*) > yjy"). * 

r ss y 

From this point, the argument used further above, leads to (3.2.1) 
for these y*,y'** Then, letting I* converge to x' and I*' to x'* 
gives y* —> x', y’’ —> x*', and hence (3-2.1) gives 

(5.2.4) 2 . ° • 

Assume next O < x*, x'* < Min (|^,|y). Then ( 3 - 2 . 4 ) holds for 
as they stand, and also with them Interchanged. Hence 

® ■ x"J (° ’ 

i.e. 

(5.2.5) J'J a^e^(x)dx = a^e^(x)dx . 

(3.2.5) can also be stated as follows: For every open sub-inter¬ 
val K of the Interval 0 < x < Min , the two functions a^e^(x) 

ay®y(x) have the same Integral over K. From this, the usual theorems 
about Integration permit us to conclude, that the x in 
0 < X < Min ^ measure 0. 

Summing up: 
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The (v = 1 , m) have the following properties; 

(a) 0 ^ ^ 1. 

(b) The X In < x < 1 with ©^(x) ^ 0 have 

( 3 . 2 . 6 )'> ^ ^ 

' ' measure 0. 

(c) The X In 0 < x < Min (^^, 1 ^) with 
a © (x) 9^ a 9 (x) have measure o. 

u, Ut ' y y 

3 • 3 * Let A be the sum of the sets aeflned In (3•2.6), (b) 
and (c). By (3.2,6) A has measure 0. 

Assume that Max < 1 • Then there exists an x ( A with 
Max < x< 1. Hence by (3-2.b), (b) all ©^(x) « 0, contradicting 
( 3 . 1 - 1 )- Therefore Max = 1, l.e., 

( 3 • 3 • 1 ) Some = 1 • 


Consider an xtA. By( 3 « 3 *l) V with Sy ^ x exist. By 
(3.2.6), (c) a^©y(x) has the same value for all such t^, say f(= f(x)). 
Hence (3-2.6), (b) and (c) give 


ev(^) 


'' = f for 


for • ly < X 


Now (5.1.1) gives 


l.e. 


(3.3.2) 




1 ^- V2X 


X ^ (±.\ a^ ^ ’ 


Sv < X 


since A has measure 0, the ©y(x) for x G A can be re¬ 
defined In any manner, without changing the strategy relevantly. Now 
(3.3.2) Is a possible definition of the ©^(x) by (3-3'l)> and It fulfills 
(3,1 .1) — no matter what x. Hence we can use (3*3-2) to redefine the 
©y(x) for X G A. 

This has the effect, that (3.3-2) holds for all x. This will be 
assumed from now on. 
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Thus the strategy is ccanpletely determined by ( 5 - 3 - 2 ), and 
(3.3.2) is stated wholly in terms of the Hence there remains only the 

task of determining the 

3.4. Assiame that « 1 for some v ^ 1 . Then by (3-3.2) 
always 0^(x) ^ 0, and also 7^ 0. Hence the goodness of the strategy 
allows y^(x) > Jf^(x) only for a set of measure 0. I.e., with such 

exertions 

^l(x) < >f^(x) . 

By continuity, ( 3 -^- 1 ) holds without exceptions. 

Prom (J-**-!), Jfi(l) < hence 

1 ^/A>V % ’ 


i.e. 


(a+a)0=o, 

i.e. = 0 for /* < V- Again from ( 3 . 4 . 1 ), jr, (0) ^ Kj,(o)> hence 

r 

^/*>i VV X/.<v \ ’ 

i.e. (since 9 ^ = 0 for /*< V, and since V ^ l) 

2 %% < 0 • 

Hence = 0 ^ contradicting 0^ o (cf. above). 

Hence the original assiiinptlon must have been wrong. I.e.: 

( 3 . 4 . 2 ) ly < 1 for V = 2 , ..., m . 

Now ( 3 - 3 . 1 ) necessitates 

( 3 . 4 . 3 ) ^ 1 = 1 * 

Assume next, tlriat some 5 y = 0 - Choose the minimal V with this 
property. By ( 3 - 4 . 3 ) V 1 , hence %y = 0, > O. Then by (3.3-2) 

ey .,(x) ^ 0 for 0 ^ X < and also = o, > o. 

Hence the goodness of the strategy allows Jfy(x) > )(y_,(x) for 
these X only for a set of measure o. I.e., with such exceptions 
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( 3 •‘^•‘^) Ify(x) < V^_,(x) for ° lv -1 • 

By continuity, ( 3 • 4 *^) holds without exertions. 

From ( 3 .^-^), Jry(O) < hence by ( 3 - 1 .^) 

\L ~ % 1 VV " ^P-^V V 

In view of = 0 this means 

(\-i - %) X^v V ^ ° • 

Hence = 0 for /a < v, contradicting > o. 

Hence the original assumption must have been wrong. This means 
that all ly 0 , l.e.; 

° ^ i ’ for all y . 

3.5. For 0 < X < Min all 6 ^(x) ^0 (cf. ( 3 - 3 ‘ 2 ))» hence 

the goodness of the stra^tegy ^ allows t^U) > »y{x) for these x only 
for a set of measure 0 . l.e., with such exertions 

(3.5.1) !( (x) < y (x) for 0 < X < Min f . 

= y sr =5 ^ A 

By continuity (and In view of ( 3 - 4 . 5 )) ( 3 . 5 . 1 ) holas without exceptions. 

Putting x = 0 In (5.5.1), and considering that it holds for 
all pairs (= 1, ..., m), gives 

(3.5.2) )fl(o) = ... = <jj(0) . 

We will use (3.5.2) to determine the remaining vmknown quantities, 
l.e., I,, ..., Ijj (cf. the remark at the end of ( 3 - 3 ))- Before we do 

this, however, we will discuss the general significance of (3-5-2). 

3.6. The assumed good strategy under consideration, l.e., the 

e^(x). Is defined by (3.3.2); the auxiliary quantities Sy are then 
defined by (3.1.2). ( 3 - 3 . 2 ) Implies ( 3 - 1 - 1 ). ( 3 - 1 - 2 ) then Irplies ( 3 - 1 . 3 )- 

In order that ( 3 - 3 - 2 ) be meaningful (for all x) ( 3 - 3 - 1 ) must be required. 
We will also use (3.4.5). (We will, however, not need ( 3 . 4 . 2 ) a-ud ( 3 . 4 . 3 ); 
we will rederlve these.) In addition the condition (3-5-2) (based on 
(3.1.4)) holds for every good strategy. 

We will see In ( 3 . 9 ) that these requirements determine a unique 
strategy (l.e., a unique system I;. •••» tm* °f- remarks at the end 
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of ( 3 . 3 ) and of (5•5))- In view of this the existence theorem for good 
strategies implies, that the strategy in question, which is the only one 
that can be good, is indeed good. However, the proof of the existence 
theorem — "Theory of Games," section 17-6 (pp. 153-155) — does not cover 
the case of a continuum of hands. It is true that its extension to 
families of games that cover this case is well known eind not at all diffi¬ 
cult. Nevertheless, the situation, as outlined, is complex enough, that it 
seems natural to prove the goodness of a strategy fulfilling the above 
conditions directly. 

This proof is quite simple. It runs as follows. 

It suffices to show, that y^(x) > ^(^.(x) liiplles ®,.(x) == 0 
(we could, of course, except a set of measure 0, but we do not need this 
now) — this means that the strategy in question is optimal against itself, 
i.e., good. 

Assume jr^(x) > Y^(x) . Then by (3-5.2) Jf^(x) - ir^(O) > ^^(x) - 
y^(0), hence by (3.1-5) (with x,o for x',x*') Oy(y) > 9^(y) for some 
y < X. By ( 3 . 3 . 2 ) 0y(y) > 0^(y) occurs only if ^ < 7- Hence 

< X. Now ( 3 . 3 . 2 ) implies 0^(x) *= 0. This completes the proof. 

3 . 7 . We proceed now to the complete determination of the strategy 
under consideration, on the basis of (3.5*2) (cf. ( 5 . 5 ) and ( 5 . 6 )). 

(3.5.2) is equivalent to 

( 3 . 7 . 1 ) V=1,...,m-1. 

In view of (3.1.4) this means 

~ ^/*>V+1 “ \+^ ^^<v+1 ^jJL * 

i.e. 


®'V+l®*v+1 




v+1 


- (b 


- a. 


v+1 




^<-v % 


i.e. 


(3.7.2) 


V+1 


- 


fv+i 


2a, 


y+1 



Adding 0^ 


to both sides produces the equivalent 




/.^V+l 


N+i y » 


i.e. 
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In 


(3.7.3) 

Now (3.1.3) 
to 

(3.7.**) 



V a 

\ * Vi h ■ 


states, that 



hence ( 5 * 7 - 3 ) Is again equivalent 



^m-l 


2 a 


'v±l_ 


^ Vi 


This Is valid for v = 1 , ..., m. 

( 3 -T-^) can be rewritten to express the 0^ themselves: For 
V = 2 , m 0 ^ obtains from ( 3 * 7 -^) for v minus ( 3 - 1 •^) for v - 1 ; 

for V == 1 0 y obtains from ( 3 . 7 .^) for V. Hence 






(3.7.5) e,. < 




%-l + ®ln 


2 a„ 


!Vi 


% Vi 


Vi ■■ 
Vi ^ 


for V = 1 


for V * 2, 


Thus ( 3 . 5 - 2 ) Is equivalently expressed by the actual determina¬ 
tion of the 0 ^ by (3.7.5) . We must now pass from this to the determina¬ 
tion of the 

3.8. Assume J ^ | . Then (3-3.2) gives > a^e^(x) 

for I ^ X > I , and a^ 0 ^(xT" = a^ 0 ^(x) otherwise. Hence by (3.1.2) 

Vv Viu. Vv “ VV Interchanging 

/.,v giv^s'^ a^e^< If 

Summing up: 


(3.8.1) I If and only If a^e^ | respectively. 

Thus the 0 ^, wiilch are given by ( 3 . 7 - 5 ), give In turn the 
ordering of the by (5.8.1). 

Let "the permutation of 1, ..., m, which 

establishes a monotone non-decreasing ordering of the 

(3.8.2) a _9 <...<a„e . 

11 ”” mm 


(If some are equal, then this definition of the Is non-unique 

to that extent, but this Is Irrelevant.) 

(3.8.1) now guax’antees 




< r 


% 


(3.8.3) 
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The determination of the must be based on ( 5 -5* 2 ) with 

(5.1.2). (5.1.2) can be written in this form: 


Yae 


(x)dx (v = 1, ..., m) , 


or equivalently 




1, ..., m) , 


or, still equivalently 


(3.8.l^) 


P >-l P-1 


T St Sr (x))dx 

) J > V V-1 >-l 


V-1 V-1 
(P = 1, ..., m) , 


where (x) are taken to be o. 


°Now ° It ° Is clear from (3-3*2), that the right-hand side of 


(3.8.U) is 


( 3 . 8 . 5 ) 


' S-1 

si; 


where , too, is taken to be o. Note, that for , the 

condition® can be replaced by o- > p, while for 

Str. = lir_ , the egression ( 5 -8- 5 ) is 0 anyhow. With this proviso 
P Pi 

then, (5-8.5) transforms into 

a„ e_ - a„ 9 _ = ^ 

V /• ">-l /»-l 2(r>/. ^ 


(3.8.6) I ^ V) (%S ■ 


(/’=!, ..., m) 


By summation this goes over Into the equivalent system 

(3-8.7) ^ iic^ = a^li;) 

^ (P = 1, ..., m) . 
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Abelian re-summation of (5.8.7) gives 

^t</»(S<r>T aj^ ‘ Sv>T+l ' 

^ 1 

The general term of the sum * V ®it ®it * Hence 

l.e., 

(/* = 1, ..., m) . 

Thus (5.8.7) and (5-8.8) are equivalent to each other and to (5-1-2.). 

(5-8.7) makes it clear, tliat O < < ... < 5ir • (5-8.8) and 

(5.1.5) (which follows from (5-7-^), and hence^ from “ “ (5-7-5)) give 

= 1. Hence 
m 

(5-8-9) ^ ^ lit. £ * • * lit , 1 lit ” ^ 

1 — m~i m 

follows from our present definitions. Thus (5-5-1) and (5-*^-5) are 
verified, as well as (ex post) the relevant property of the permutation 
Tt^, ..., 1 T^ (l.e., (5-8.5))- 

5-9- (5-7-5 ), (5-8.2 ), (5.8.8) contain a complete definition of 

the 9^ and I , hence with the help of (5-5-2) the 9^(x) are completely 
defined. I-e., we have completed the determination of the good strategy, 
and shown that it exists and is unique. 

We observe further: By (5-7-5) 

2a^ Sag 

° ^m-l ■ ••• ■ ' 

and for v = 2, ..., m 




hence 
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®v®v 


2a. 


v-l 


\-2 ®V -1 


2a„ 


2a, 


+ ag 


s -1 


2a 


V-1 


2^,-2 ■ • 

^^>-1 
®v-i ■ 


2a, 


> 1 , 


2a,, 


S;-i 


- a,. 


i.e. 


a,ei 


a 0 
W 


Now (3-8.1) gives 

(5-9.1) for v= 2. ..., ID , 

and therefore (3-8.2) prescribes (iinajnblguously, cf. there) 

(3.9.2) * 

This verifies (3 -^- 2) and (3 - ^- 3)- 

^ 4. GENERAL CONSIEERATIONS 

4.1. It is of Interest to see, how the case (II), corresponding 
to a finite number of allowed bids (treated in (3)), converges to the 
case (I), corresponding to a continuum of allowed bids (treated in (2)), 
when the allowed bids of the former (cf. (II) in (1)) spread densely over 
the entire allowed Interval of the latter (cf. (I) in (1)). 

Consider first the general situation, where a finite nimiber m 
of bids, according to (II) in (1), is allowed, and where the mesh-width 


(4.1.1) 


i = tox (a,_, - a^) 


of this bid-system converges to 0. 

Let an dC with a ^ > b be given. Choose v 

a^ > di* > . Then by (3-7.4) 





e 



^>v a 


2a, 


•A-1 ^ 




e 


A>V 


In 




2a 


X 


with 
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l^5 


= e" 


+ 


1 ^A-1 ' °’A \ 

2 ) 


R^laclng ln( 1 +1 ^ ) by ^ ln( 1 + - - ) changes It by 

o((a^_^ - a^) ), l.e. by ) • Hence^ the entire 

changed by 0(g.(ay - ^o(£(a - ■b))j i-e- by 0(g). Thus 


X e = ^ 

^a,.V ^ 


^A-1 " ^A 


^ + 0(g) 




. ,-S)>>v 5 1”-if * ““> 

1 

“2 


- <’ • 

a ^ 

- (1 - o(t))(i;) • 

Now a^j = b, a^ = + 0(t) (1 + 0(£))oi.', hence 


h’"' 


I.e.: 
(4.1. 2 ) 




-> (;^) fo’’ £->o 

The right hand sloe of (U .1 . 2 ) is equal to 


(4.1.3) (|i(tA)di*. + (1 - Xq) , 

ol' J 

with the $(<*.) of (2.1.6) and the of ( 2 . 1 . 7 ). l-e. the a priori 
probabilities for the bids a^ define e distribution that converges 

(for £ —y 0 ) to the distribution with the cumulative distribution func¬ 
tion ( 4.1 . 5 ) — i.e. with the probability density $(01.) in a > oi ^ b and 
the point probability 1 - at <>4 = a. According to ( 2 . 3 ) this is 
precisely the distribution of a priori probabilities of bids that character¬ 
izes the good strategies that were obtained in ( 2 ) for the continuum case, 
l.e. (I) in (1). 

In other words: If the mesh-width of the bid system (cf. (4.1.1)) 
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> 1.6 

converges to o, the distribution of a priori probabilities of the bid 
system for case (II) converges to that one for case (I). 

To this extent, then, we have continuity. 

l^.2. The behavior of the a priori probabilities, l.e. of the 
(or, rather, of the %)> turned out to be continuous. Let 

us now consider the ey(x) tfemselves, or, which in view of (3.3.2) 
amounts to the same thing, the 

Consider again the set i?) of •^. 1, more specifically £ —> 0 for 
the £ of (^.1.1). ¥e will prove, that this is compatible with a wide 
variety of behaviors for the 

¥e observe first, that (3.7.3) implies 

T a S ffv+lT e 

^ ft ^ 2ay /*- * 


l.e. 


\ ^ %+l Sft<T;+i ^fL 


l.e. 


V ^ monotone decreasing function of v- 


(i^.2.1) 

In addition to this, obviously, 

(U.2.2) 

Prom these (with v - 1 in place of V): 

r - Vl)S^<V-1 V ^ monotone function of 


2/4<v V increasing function of V- 


(‘^•2•3) -< 


V (= 2, ..., m), if a - ay_, ( 


= J 


(T a 


v-i 


[ (rf constant), l.e. if the a^ form an t^om^rlc^^ progression. 
Now by (3.7.2) (with v - 1 in place of v) 

(U.2.4) a^e^ Vl^S/.<v-i V 

Combining (‘^.2.3) and (4.2.4) with (3-8.1) and (3.9.1) gives therefore: 
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hi 


(^•2.5) i I £m< ••• < S2< ^1 


if the form an 


I f S*rlthlD©ti.C ^ rv»^ 

L ‘geometric ‘ Progression. 


Hence ( 5 . 8 . 2 ) prescribes (xmambiguously, cf. there): 


(4.2.6) 




Vi 

= m. 

^m 

Vi 

- 2 , 

ir 

m 


if the a^ form an 


rarithmetic. 

geometric progression. 


The arithmetic progression Is given by the formula 
(4. 2 . 7 .a) 

and the geometric progression is given by the formula 


o - « ID - V ^ V V - 1 

V m - I m - j 


m~v Ti-1 

(4.2.7.b) a^ = a”-’b“-l 

As ra—•> », both bid-systems (4. 2 . 7 . 1 ) and (4.2.7.b) spread 
densely over the entire Interval — l.e. in both cases the 

mesh-width g of (4.1.1) converges to 0. Nevertheless, ( 4 . 2 . 5 ) shows, 
that the two bid-systems command altogether different good strategies 
(i.e. "bluffing” procedures): The hands x < ^ ones which do 

not command the highest bid (a.j) exclusively (cf. (5»3*2)) — l.e. these 
form the range for "bluffing," in the sense of the interpretations of 
"Theory of Games," section 19*10 (pp. 204-207)- (3-3-2) and ( 4 . 2 . 5 ) show, 

that in this region weak hands favor high bids when the bid-system 
(4. 2 . 7 .a) is valid, while strong hands favor high bids when the bid-system 
(4.2.7*b) is valid. 

(4.2.6) permits calculating the |y in both cases. This can be 
used to Illustrate the points made above further, but we will not go into 
this in detail at this occasion. 

4.3- Actually, the permutation vc^, • • • ^ ^' -. -, m (cf. 

( 3 . 8 . 2 ) and the text that precedes it) can be prescribed entirely at will, 
as long as the necessary condition itjjj = 1 (cf. ( 3 - 9 - 2 )) is fulfilled. 

This can be shown as follows. 
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Assume v = 1, ..., m - 1. In view of = i (cf. 

(3.1-5)), (4.2.2) Implies ®/ 4 . ^ (4.2.1) Implies 

\ ^ ^m' ®in “ Inhere follows 

(4.5.1) I < »^ < 1 for -v = 1, ..., m - 1 . 

Replace V by v - 1 In (4.3.1). Then (4.2.4) gives 


(4.3.2) 


for V = 2 , ..., m . 


Let , . . ., /®jjj be the Inverse permutation (of 
ir^, ..., iTj^. Assume thab 


(U.3.3) 


- 


^•v-1 “ *^^0^ 


for V - 2, 


m. 


.. ., m) to 


for a suitable constant h (> 0). Then (if. 3 * 2 ) becomes 




^b' 




< T 




i'oi* V 2, . .., m . 


Now ^ (f«., V = 2, ..., m) liaplles /% - 1 > /^, aiio thence by 

(4.3.4) a^Gy > I-®- monotone increasing functions 

of /»y for ^-^2, ...,m, i.e. for v / 1. Therefore the 
monotone increasing functions of P for tc^ / 1 , i.e. (because of 

the stipulation of ^ > cf. above) for / m. The exclusion of 

P = m may be removed because of (3*9-1) (ana tne st'* lulation of = 1) 
So we biave: 


(4.3*^) 


u, ir, 


< V 




In view of (3.8.2) this means, ttiat these IT,. ..., Ifn, are .ndeed the 
(unique) ITj, •••,■% of the present exanple. 

There remains the task of safeguarding ( 4 . 3 . 5 ). Since a.| - a, 

( 4 . 3 . 3 ) Is equivalent to 

(4.3.6) = a - h ^(f)^^ • 

This condition a = a, > a^ > ... > a^j|_, > a^^^ “ b is now automatically 
fulfilled, except for Q-ju “ This means 
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= a - b , 


l.e., since 


is a permutation of 1, ..., m, 



Hence 


(4.3.7) 


h = 


a - b 




meets this requirement. 

4.4. Examples of various kinds could be multiplied beyond this 
point. Instead of pursuing this, we make the following general remarks 
about the ordering of the according to size. 

The position of | ^, in this ordering is determined a priori by 
(3-9.1): It is the largest one. Hence we need to consider the with 

“v =■- 2, ..., m only. Combining (3.8.1) and (4.2.4) shows, that the 
ordering of these coincides with that one of the 


Now let the bid-system of (II) in (l) spread densely over the 
entire Interval a>oC^b — l.e. let the mesh-width £ of (4. l . i) con¬ 
verge to 0. Consider the two factors of (4.4.1) separately. 

The second factor of (4.4.1) was dealt with in (4.1), and it was 
seen to converge to a simple function of <*.* -- the connection between ol* 
and V being given by 1 ^ obtains from the corresponding 

condition in (4.1) by replacing v by V - 1). This function of is 

given in (4.1.2), and interpreted in (4.1.3). It is continuous in ol» , 
hence asymptotically infinitesimally slowly varying in v. 

It follows therefore, that the ordering of the quantities (4.4.1) 
(i.e. of the gy referred to above) is determined primarily (l.e. apart 
from "long range effects" in v, l.e. effects that manifest themselves 
only on the ec'-scale) by the first factor of (4.4.1), which is ^ - a^. 
In the relevant comparisons of size, of course, only the relative sizes of 
the a^__^ - a^ matter, those belonging to "remote" V-regions (l.e. to 
regions relevantly separated on the a*- scale) being weighted against each 
other asymptotically by the limit of the second factor of (4.4.1). This is 
the fmctlon of oL* given in (4.1 .2). As a weight function this amounts to 

(cL') or, which comes asymptotically to the same thing, to Q'y 
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With these reservations, then, the ordering of the in ques¬ 
tion corresponds to the ordering of the - a^. This quantity is the 

excess over a^ of the next higher bid, a^^^^ — l.e. the mlnlmuin overbid 
over a^. 

This result lends itself to an easy and plausible interpretation. 
Tlrie mlnlinuin overbid over a given bid (a^) expresses in some sense the 
degree of defensibility of this particular bid. Indeed, it specifies the 
price (as an increase in risk when met by still higher bids, or by the same 
bid combined with the differential danger of a stronger hand) at which the 
bid in question can be defeated. It is plausible, that the strategic de¬ 
sirability of any particular bid should be reduced at will by allowing 
"cheap” overbids over it. The remarkable thing about our result is, that 
it furnishes (by way of (5.3*2), together with (5.8.2), (3.8.8)) a quanti¬ 
tative implementation for this qualitative insight. The asyinptotically 
defined long range comparison principle for the minimum overbids 
(ay_^ - a^)^ with the help of the weight function Introduced further above 
(a^""^) is a particularly striking phase of this, but it is only 
one phase. The complete result is the one as summarized at the beginning 
of ( 3 . 9 )* 
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THE DOHBM DESCRIPTION METHOD’ 

T. S. Motzkln, H. Raiffa, G. L. Thompson, and R. M. Thrall 

INTROmCTION 

The purpose of this paper Is to present a computational method 
for the determination of the value and of all solutions of a two-person 
zero-sum game with a finite number of pure strategies, and for the solution 
of general finite systems of linear Inequalities and corresponding maximi¬ 
zation problems. 

Although a system of linear equations forms a particular case of 
a system of linear Inequalities, the comparative efficiency of numerical 
methods of solution la very different for the two. In the case of linear 
equations It Is as yet undecided whether direct or Iterative methods are 
generally preferable, the aim of both types of methods being to solve a 
system which Is supposed to be non-singular and, therefore, to possess a 
unique solution.* 

For Inequalities all numerical methods hitherto used. Including 
probabilistic methods and descent methods with or without distance check, 
are essentially approximative and reach, after a finite or Infinite number 
of steps, a particular solution. However, systems of linear Inequalities 
correspond. In general, to singular systems of equations and may have none, 
one, or Infinitely many solutions. If It Is desired to determine the 
totality of solutions (In parametric form) these methods will not do. 

The totality of solutions of a finite system of linear Inequali¬ 
ties occupies a bounded or unbounded convex polyhedral set In Euclidean 
space whose description may be of theoretical Interest. In applications 
when minimization In various directions Is required, as for example. In 
optimization problems within an otherwise fixed economy with variable price 
vector, the full determination of the solution set may be necessary or 
time-saving. 

This determination can be effected by any one of the direct 


^The preparation of this paper was sponsored (In part) by the Office of 
Scientific Research, USAF, and (In part) by the Office of Naval Research. 
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methods. Among them aeterminants are impractical already for equations. 

The other direct methods amount to progressive reduction of the coefficient 
matrix by left or right multiplication. 

A particular procedure of left multiplication is the elimination 
of the unknowns, one by one, and this method (which for equations, though 
very nuch older, is called the Gauss method, and is one of the best bets 
In the race for maximum efficiency) was proposed for linear inequalities by 
Fourier [ l ] ^ but seems to be entirely out of question because of the huge 
num’-er of elementary operations involved, which grows extremely fast with 
the number of unknowns and inequalities. 

Right multiplication on the other hand, as represei t:ed by the 
successive solution of one, two, etc., inequalities until arriving at the 
whole system seems to be within the range of macnine, and sometimes of 
liana, computation, as we hope to corroborate in the present paper. The 
advisability cf the same method adapted to systems of equations is under 
coiisldei it ion. 

The idea was, as far as ve know, first used in the dissertation 
of T. S. Motzkln ( 2 , pp. 2k~-2t] for purely theoretical pumoses (a proof of 
a general.^zacion of Mlnkowsk'^ ‘s theorem on the fini aness of a base for all 
solutions of a finite system of linear inequalities). 

Independently Ralffa, Thompson, and Thrall [ 6 , 7 ] developed the 
correspondii 3 computational jcheme for the case of finite games.^ The ex¬ 
position of -.his scleme is given in Parts I and II. The number of steps 
in determinin'’’ the solutions for one player is equal to the number of pure 
strategies of the ot/.er player. Frequently the solutions for the first 
player can oe ^ sod to shorten the Cv^mputatlons for tlie solutions for the 
second player. A tectolque whlc.. enables one to determine optimal strate¬ 
gies for player II utilizing the con’putations for player I is being 
investigated. 

Again Independently, the computational scheme for general systems 
of linear inequalities was given by T. 1. Motzkin [ 5 ]. This procedure 
forms the content of Part III. 

PART I. INTUITIVE CONCEPTS OF THE GAMES 
^ 1 . NOTATION 

Let A « I la^. j| I be the matrix of a two-person zero-sum game in 


^Numbers in square brackets refer to the bibliography at the end of the 
paper. ^ 

^Thls procedure has since been adapted for Linear Programming. 
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which player I has m pure strategies <^ 2 * * * * ^ **‘m player II h8.s 
ri pure strategies p^, ***' PS-yoffs a^j to I and -a^j to 

II if the strategies chosen. A row vector ^ ..., fp) 

will he called a probability vector of dimension p if ^ = 0 U. e., 
each = 0 ) and if + • • • + |p = 1 • denote by Sp the set of all 
probability vectors of dimension p. We admit as mixed strategies for 
player I the set of all probability vectors | having m components and 
for player II the set of all probability vectors vj having n components. 
The corresponding payoffs will be 

( 1 ) 

to I and to II. (Here denotes the transpose 

of »|.) 

Let the row and column vectors of the matrix A be denoted by 


(S) 


Ri “ 11^11. •••. a 


In' 








We then have 


(5) ^ 

The vector x =- x(|) = (x^, —•.» where Xj = Xj(|) ^ 

is called the marginal vector corresponding to the strategy ^ for 
player I and similarly y = y(>|) = (y^, ***' ^m^ where y^ - y^(y|) = 
is called the marginal vector corresponding to the strategy vj for 
player II. 

If player I chooses th'i strategy ^ then his payoff will be at 
least the minimum component of the vector x(^) . It is well known 
(cf. [?], p. 159 ) that the objective of player 1 is to select a strategy | 
so as to maximize the minimum component, thus he can be assured a payment 
of at least 


(4) V., = max 

(We use here the fact that 

Similarly player 
to I is no more than 


min x.(^) = max niln E-(?,»}) . 
j J ^ ^ 1 5 ( 

min x(0>) = min xA \).) 

T j ^ 

II can play so as to be assured that the payoff 
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(5) Vo « min max « min max E-d,))) . 

2 YJ 1 ^ ‘ J ‘ 

The mlnlmax theorem states that * Vg « v (for proofs see 
[5], p. 128 , ff. and [10], p. 19 ). 

We say that f(|) = min Xj(|) Is the minimum function for 

player I and call those | which maximize f(^) optimal strategies for I. 
Similarly we call g(>j) = max yj^(>l) the maximum function for player II 
and call those >j which ^ minimize g(y|) optimal strategies for II. 

i 2 . A GEOMETRIC MODEL 


Let Ep he real cartesian space of dimension p and let Ep_^ 
be the subspace of Ep consisting of those points with last coordinate 
zero. We choose barycentrlc coordinates In Ep_^ based on some set of p 
scattered points (for Instance the origin and the unit points on the first 
p-1 coordinate axes would do). A point p In Ep_^ belongs to the 
closed simplex with these points as vertices If and only If Its barycentrlc 
coordinates c^, ..., Cp constitute a probability vector. Thus we can 
realize Sp as a closed simplex in Ep.i 1 with the probability vector | 
represented by the point whose barycentrlc coordinates are | . 


For exan 5 )les, 
coordinates) 


is realized by a line segment (with some typical 


(1,0) ( 5 A,iA) (1/2,1/2) ( 1 / 4 ,5A) (0,1) 


and by a triangle, viz: 



Any point P In Ep can be specified by the p barycentrlc 
coordinates , ..., |p of Its projection In Ep_^ together with Its 
final ordinary Cartesian coordinate x and we write P - (|^, ..., | ; x) 
or for short P = (|;x). (Here | need not be a probability vector.) We 
denote by Pp the set of all points P = (^;x) In Ep for wlUch t ^ Sp 
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and call Pp the game space of dimension p. 

Suppose that h(|) Is any real valued function defined for all 
vectors | G Sp. We can represent h(|) geometrically by the surface In 
Pp consisting of all points (|;h(|)) for J G Sp. 

Since only Pg and P^ can be realized plctorlally, we now 
embark on a discussion of 2xn and 5xn games to motivate further alge¬ 
braic considerations. 

^ 3 . THE 2x2 GAME 
Let the play matrix be 

^*11 ^*12 

A - 

^•21 ^*22 

and corresponding to € Sg we can find the marginals, viz: 

’*■ ®’ 21 ^ 2 ^ ^2 “ ^* 12^1 ^* 22^2 * 
Geometrically, these marginals can be plotted, viz: 


The two straight lines represent the marginals as a function 
of |, l.e., x^ = (I C^), Xg = (g Cg). The dark line represents the 
minimum function, f(g) = min (| Cj) of player I. The maximum of this 

minimum function Is v, which occurs at the optimal solution (§?iSo)* 

1 (2) ic 

Note that Is decomposed into subsets Sg^ ' and Sg' The above 

diagram Incorporates all the essential feat\ares of the game when the 
optimal strategy (|°42^ Is an Interior point of Sg. 

We Illustrate In the figures below typical examples of 2 x 2 
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games including all possible ordering relatlonshiips among the elements of 
the game matrix. 













In the cases (c), (d), and (h) all strategies for I are optimal. 
In case (f) there is a subset of optimal strategies. In cases (b), (e), 
(g), and (1) the optimal strategies occur on the boundaries and thus I has 
a unique pure strategy. In all cases the set of optimal strategies forms 
a convex subset of Sg. Those optimal strategies which occur at the 
intersection of two of the four lines x = x * JCg, = 0, fg “ ^ 

are called basic ‘^Jtrategies. In each case the convex set generated by the 
basic strategies comprises the set of optimal strategies. Algebraically 
then, the basic strategies are the solutions of a proper system of linear 
eq-uations. 

To find the point of intersection of the marginal lines for 
player I we solve the system: 
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®11^ 

®21^2 

- X « 0 


^■1251 

CVl 

•U/I 

CVl 

CVJ 

oj 

+ 

- X = 0 

The determinant of the system is 

^2 

« 1 

4) (A) - 


^21 

-1 


^12 

^22 

-1 


1 

1 

0 


which is easily seen to be the sum or the elements of the adjoint of A. 
By Cramer's rule we tiave, provided <|)(A) ^ o. 


^ ^22~^21 i ^ ^n~^12 ^ det 

’ it)(A) ' ^ (|){A) ' 


If we define the special matrices 

= 111 111 


then we can write the solution as 



(ad1 A) 

kA) 


iC = 


1 

1 


X 


det A 

^ TOT • 


By a similar analysis, the point of intersection of the marginals for II is 


T) - (ad.i A)1^ _ det A 

* “ (pCA) ’ “ TTaJ • 

In cases (b), (c), and (d) the marginal lines are parallel and 
(|)(A) =0. In cases (e) and (h), (|)(A) / •; bit the point of intersection 

lies outside of the game space and does not represent a basic solution. 

In case (g) the point of intersection lies in the game space but again it 
is not a basic solution as it is not the maximum of the minimum function. 

If we now include the lines = 0 and ^2 “ ° Possible 
equations we get additional points of intersection, namely (1,0; ^), 

(1,0; ag^), (0,1; a^g), (0,1; agg). Algebraically, then, a method of 
procedure would be to find all points of intersection (which we call criti¬ 
cal points). Those critical points which lie in the game space and lie on 
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the maximian of the minimum fiinctlon represent the hasic solutions. The 
entire set of optimal solutions consists of convex linear combinations of 
these basic solutions. 

We will indicate subsequently why this procedure of computing all 
critical points is not computationally economical. However, this method 
generalizes to give the results in [8], page 55, concerning the determina¬ 
tion of the basic solutions. 


i 4. THE 2 X n GAME 
Here the play matrix is of the form 



and the marginals are j “ l» 2, ..., n. Again, we 

plot these marginal lines in Pg* As a typical example let us consider the 
diagram for a 2x5 case: 



The minimum function for player I is given by the broken dark line, the 
optimal strategy is fi^nd the value of the game is v. In the 

above diagram there are nineteen critical points Involved, some of which 
are obviously unimportant. Since in higher dimensional cases we cannot 
have the siqjport of a diagram and hence cannot see which points are^ 
important, we want now to devise a computational procedure from purely 
algebraic considerations. In Part II we will discuss the formal details of 
the computational procedure, but for the present we use the above diagram 
to illustrate our procedure. 

Since x^(§) and x^(^) take on minimum values on the boundary 
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planes « 0 and ° first consider the minimum function of 

these two marginal lines, viz: 



Now evaluating and at the critical points (l,o), 

(0,1) we note that these lines lie above the minimum function and so may 
be discarded. But Xg at below the critical point and 

hence we must find the points of Intersection of x^ and Xg and of Xg 
and x^. We then discard the critical point arising from the intersection 
of x^ and x^. The critical point with the largest x value then gives 
the optimal strategy and the value of the game. 

i 5 • THE 5 X n GAME 


In the 3 X n game 


'11 

^2 

• . . 

®ln 

‘21 

agg 


^■211 

'31 

^52 

... 



we consider the game space viz: 



Each marginal function Xj(§) can be represented as a plane in P^. It is 
now possible to represent geometrically I*s minimum function and to find 
the optimal strategies and value, v, of the game. A basic strategy, 
is an optimal solution such that is a point of inter¬ 
section of 3 planes (we include boundary planes *0, 
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■"a; I2 = $3 " 

The geometrical model for the three dimensional case can he 
constructed analogously to the two dimensional model with planes playing 
the role of straight lines. It is suggested the the reader keep this model 
in mind while reading the next part of this paper. 

PART II. THE COMPUTATIONAL PROCEDURE 
k 6 . SUMMARY OP PROBLEM 

As we have seen, the goal of player I is to find those ^ which 
maximize his minimum function f(^). Since the marginals Xj = §Cj are 
hyperplanes in the minimiam sur|'ace x = f(|) in E^j^ is a polyhedron 

and so can be coirpletely described by giving its vertices which are, of 
course, finite in nTomber. We now develop a systematic coinputatlonal pro¬ 
cedure for determining these vertices. Suppose the vertices are 
Qi = (i^^ ^^ ^) > • • • ^ ^ ). Then v - max x^ is the 

f J 

value of the game and the for which x^*^' = v are basic optimal 

strategies in the sense that the set of all optimal strategies is just the 
set of points in the smallest convex subspace of S^^^ which contains these 
maximizing see i8], page 28 , 30 . It can be shown that the two 

definitions of basic strategies are equivalent, see [6], appendix. 

^ T. THE SOLUTIONS FOR PLAYER I 


A basic component of the computational technique, to be discussed, 
will be to find the Intersection of the line segment joining two points of 
and a hyperplane in To this end, we introduce the following lemma. 


LEMMA. The line segment joining the two points 
Pi = x^^^) and Pj = in 

Intersects the hyperplane: i ^ ^m^ 


only if < 0 where d[^^ = 

and d^^^ = In particular, if 

^(k) ^(k) ✓ f.'h<=^n -nnlrrh nf 1 t.i nn. P. 


In particular, if 


^i ^ ^j ^ ^ ® point of intersection, P, is 

unique, and given by the relation: 



Proof. The line segment joining P. and P . can be parametrized 

J 
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by the relations tP^+ (1 -t)Pj where 0 < t < l. This line segment 
will intersect the hyperplane if and only if there exists a t in the 
Interval [o,i] such that 

(t + (1 - - (t x^^^ + (1 - t)x^'^*^) = 0 , 

or if 


+ (1 - = 0 
J 


If = 0, then the point lies in the hyperplane. If dV"' = o 

then the point P . lies in the hyperplane. If di^' = d^.^^ = 0 then the 


lies in the hyperplane. If d;. ^ = o 


ui-xv;?!! uxxo JT j jlxx uiio ixjpox-^-i.ca.xio • u.^ “■ u.j uii^ix uixc 

line segment lies in the hyperplane. If both d^^ and d^ are different 
from zero and of the same sign then there is no solution of 7-1 for 
0 ^ t < 1 . If, however, dj ' and d^ ' are different from zero and of 
different sign (l.e., dj^^ d^.^^ < o) then there is a unique solution of 
(7.1) given by 



and then the point of intersection is 

P = 

which completes the proof of the lemma. 

For conputatlonal purposes we introduce the column vector 




and then d[^^ = d(^^ = Pj.Cj|,. 

In computation of points it is necessary to know not only the 
coordinates of the point but also all the planes (or hyperplanes) which pass 
through the point. Let TTj^ denote the boundary plane (of P^^) which has 
the equation = 0 (1=1, 2, ...,m). The planes in question are the 
m boundary planes iTj, plus the n marginal planes Cj.(j = 1, 2, n). 

A point in Pjjj is determined by the intersection of m planes and we 
adopt the notation 
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P 





P 


m 1 


[ "^i * • • *^m 


where T^, • • - > ™ n + m planes mentioned above. We may 

later wish to add other planes to this symbol if they contain the point P 
but this will become clear in the following discussion and in the examples. 
We call P* the labelled point corresponding to P. 

A "corner point" of a plane Cj is the piercing point of the 
plane and a line which is the intersection of m-l bo\mdary planes. For 
example in the 2x2 case 


^•11 

a, 2 

^21 

agg 


the corner points of with the appropriate labels are 


1,0;a^ ^ 

Ci.lTg 


and Pg = 


*^21 \ 
) 


At a "corner" of it is clear which plane is part of the 
minimum function — namely the plane or planes which contains the row 
miniTTift corresponding to that corner. Hence we assume the matrix A is 
written so that the columns containing the row minima have the lowest index 
since these planes will certainly occur in the minimum function. Prefer¬ 
ably, we consider those colxomns containing the most row minima first since 
they probably are the most important. 

The first step in the procedure is to write down the labelled 
corner points of j l.e.. 


^2 


1,0,...,0;a^ ^ 

c, .TTg, . . .jTTjjj 
0»1 »•• 

. \ 


0,0 ,•• 


These n points completely determine C,. They form the Initial set of 
critical points in our computational procedure. 

Next evaluate d[^^ = - x^^^ = P^Cg for 1=1,2, ..., m. 
Now we want to add new critical points to those obtained above according to 
the following rule; 
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Find the piercing point of the line segment joining and 

Pj, and the plane Cg If ^ 

1 . d(^^ dl^^ < 0, and 

1 2 

2. the line segment joining P^^ and P^^^ Is an edge of 

the minimum surface bounded liy TT,, .IT and C, . 

1 m 1 

This critical point Is to be added to the above set and labelled 
with Cp and the planes common to P^ and P. . 

ii ig 

A geometrical Interpretation of the above step Is the following. 
Condition 2 Insures that the two points lie on an edge of the minimum 
surface determined by the planes already considered In the process. Condi¬ 
tion 1 Insures that Cg Is above one of the points and below the other 
point so the line between them pierces Cg. Hence this piercing point Is 
Important In the construction of f(^). 

To all labelled points such that d|^^ - o we must add the 

plane Cg to the label since It may be Important later on to remember 
that Cg passed through these points (e.g.. In satisfying Condition 2 
above for later steps In the process). 

Next we eliminate all critical points with d^^^ < o since 

plane Cg goes below them. 

Finally we add all corner points of Cg which are relative row 
minima of the payoff matrix, e.g., those whose y coordinates satisfy 

^12 ^ ®'11 • 

We take account of the results of the last two operations by 
means of Index sets defined as follows; let be the set of Integers 
1,2, ..., m; let Kg be the set of Integers l(l < 1 ^ kg) (where kg 
is the total number of points considered In the first two stages) which are 
the Indices of those points not eliminated In the first two stages. 

We now have found all the luportant critical points of fCJ) 
which arise from the first two columns. Next take the column C^ and 
repeat the above process, then C|^ etc. up to C^. 

In order to avoid introduction of extraneous points which are not 
vertices we need a criterion which will tell us, at any stage, whether or 
not two vertices are adjacent (l.e., connected by an edge). A necessary 
condition at the end of the h-th stage for P^ and Pj to be adjacent Is 
that they shall have at least m-l planes of the set 2)^^^ « 

•••> C^, ..., Cj^} in common. However, it may happen that certain 

planes will be dependent and then the number of common planes can be greater 
than m-l . Suppose that P^ and ? • have the subset “ 

(T^, ..., Tj,) of as their set of common planes. Then and Pj 
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will be adjacent if and only If no other vertex is on all of the 

planes of Sj• 

In the practical determination of adjacent vertices the plan 
followed here is first to check for all pairs of vertices with at least 
m-1 planes in common and then to determine which of these pairs are 
actually adjacent. 

We summarize the procedure now in a minimal set of rules given 
in an inductive form. 

STEP 1: 1 . Label columns containing the row minima of A with 

lowest index. 

2. Confute the initial set of critical points con¬ 
sisting of the m corner points of , and 
initial index set = {1, 2, m} . 

STEP j+1 : Assume the j^t^ step (j = 1 , 2, . .., n - 1) to be 
completed with critical points P^, ^k. index set Kj obtained. 

1. For each critical point P. = i G K 

M+i) » ^ J 

conpute ' = ^i^j+1 ‘ 

2. Add the symbol to the label of all points P^ 

such that = 0* 

3- Find the piercing point of the line between P^^ 

and P. and the plane C. , if ^ 

-^2 ‘ 

(a) < 0 

1 ^2 

(b) m-l of the planes in each of the labelled 

points P. and P. are the same, and the 

^2 

vertices P. and P. are adjacent. 

-1-1 ±2 

This point is to be aaded to the set of criti¬ 
cal points and the planes in Its symbol are the 
planes which the two points above have in common 
together with Cj^l. 

k. Add to the set of critical points all corner points 
of Cj^l which are relative row minima, i.e., whose 
X values satisfy 

‘^11' ^12 •••' • 

5- Eliminate all critical points vlth < 0. 

6. On the basis of rules 3 , k, and 5 compute the index 
set Kj .^1 from the set Kj. 

At the conclusion of n such steps a finite set of critical 
points which completely describe f(§) is obtained. 
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^ 8. example 

The computational technique for the game 
11 3 2 13/5 


2 

0 5/2 1 

2 1 8/5 


10/3 

1/2 

1 


is given in Table I. 


Step 1 


Step 2 


Steps 3,4 


Step 3 


p 


X 

Cl 

Ca 

C 3 

Cl|. C 5 1 

2 

5 


d5 

d** 

d^ 

1 

1 0 

0 

1 

X 




X 

X 

2 

1 

8/5 

T/3 

2 

0 1 

0 

2 

X 



X 


X 

-2 




5 

0 0 

1 

5 

X 



X 

X 


-1 




4 

1/2 1/2 

0 

3/2 

X 

X 




X 


5A 

3/10 

5/12 

5 

1/3 0 

2/3 

T/3 

X 

X 



X 



-1 



6 

0 0 

1 

2 


X 


X 

X 



-1 



T 

0 1 

0 

0 


X 


X 


X 


5/2 

1 

1/2 

8 

0 2/Y 5/7 

10/7 


X 

X 

X X 





0 

-Vt 

9 

2/3 0 

1/3 

5/5 

X 


X 


X 




3/5 

8/9 

10 

5/7 2/7 2/7 

13/7 

X 

X 

X 

X X 





0 

0 

1 1 

0 0 

1 

1 



X 

X 

X 




3/5 

0 

12 

0 2/3 1/3 

2/3 


X 


X X 





TABLE I 


STEP 1. Relative to column we get points Pg and P^ 
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together with the bookkeeping symbols denoted by x*s in the appropriate 
columns. 

STEP 2. Pill in column d^^' with entries d|^^ « P^Cg for 
i = 1, 2, 3- Compute piercing points and P^ by formula given in 

Lemma. Label appropriate planes in bookkeeping section. Add the corner 
points Pg and P^. Strike out Pg and so that Kg = [i, 5, 6, 7). 

STEP 3- Pill in column with entries i G Kg. 

Conqpute piercing points Pg, P^, P^q. Label appropriate planes in book- 
keying section. Add corner point ^. Strike out P^ and Pg so that 

Kj - (1, 7, 8, 9, 10, 11). 

STEP 1*. Fill in columns d^^^ with entries dP^ = P^Cj!, 1 G K,. 
Since > 0 for all 1 G K^ there are no new points. Add to 

labelled points Pg and P^q. Now Kj^ * K^. 

STEP 5- Pill in coluinna with entries i 6 K^. 

Coiyute piercing point P^g and delete point Pg. Add to labelled 

points P^Q and P^^. 

The value of the game is given by P^q. The optimal strategy for 
player I is (3/7, 2 / 7 , 2 / 7 ) yielding a value of 13/7* Planes , Cg, 

Cj, Cj^, and all pass through this point. 

^ 9. THE SOLUTION FOR PLAYER II 

To obtain the entire minimum function for player II it is neces¬ 
sary to take the negative transpose of A and repeat the process as 
described above. However, if one is only interested in obtaining all basic 
solutions for player II then once the basic solutions for player I have 
been determined the solution for player II is (possibly) made somewhat 
easier. If for any basic solution of I the marginal is greater 

than V, then eliminate the column Cj from A. After all such elimina¬ 
tions have been made call the matrix so obtained B. The columns of B 
are the totality of all non-boundary planes which are common to the symbols 
of all basic points of f($). Suppose tliat B is an m by p matrix 
where p < n. The solutions of the game with B as payoff matrix are the 
same as those with A as payoff matrix, since II will not play with 
positive probability any column of A which has marginal > v for any 
basic solution of I. 

To find the solution for player II it is now only necessary to 
take the negative transpose of B and solve the resulting game according 
to the process described above. The basic solutions for the game with A 
are then obtained by extending the basic solutions for the game with B to 
n-dlmensional vectors by putting o*s in the n-p places corresponding to 
columns eliminated according to the paragraph above. 
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The minimum function for player II for the exaitple of section 8 
Is discussed In [6], page There are three basic strategies for 

player II, namely (7/21, k/2\, 10 / 21 , 0, 0), ( 3 / 7 , 0, 0, 3 / 1 * 1 ), and 

( 21 / 63 , 0 , 22 / 63 , 20 / 63 , 0 ). 

PART III. GEOffiRAL INEQUALITIES AND SECOND VARIANT OP THE 
COMPUTATIONAL PROCEDURE 


410 . ROUGH PROCEDURE 


Let >0, j - 1, ..., h; k = 1, ..., n; be a system 

of h Inequalities In n unknowns. Sv 5 )pose that the general solution of 
the system formed by the first h - 1 Inequalities Is given by 

A. 


= SPkl^l' 


Pki, taking on all non-negative values. 


Then the h"^'^ inequality will determine a half-space (or the whole apace) 
both In x-space and A-space. Putting b^ = the common part of 

the halfspace !Sb,A, > 0 and of the positive A-orthant will be the convex 


cone generated by the rays from 
linlt vector) for every 1 with 


every and Ig with 

qki„> ”* = “(1) ° ’' • • •' ' 

■by gjan’ *” = “(ii 


toward e, (e., denoting the 1 


b-j^ > 0, and (| bj^ 


bi bi <0. Denoting Pj^.^ 


|e, + 

■‘•1 
for 


Ih, 


lei 


bi > 0 


) 

2 

by 




^1 

i., ±2 


ig) 


s, and Pj^i^ I 

3 + 1, ..., t, the complete solution of the 
t 


for 


< 0 


inequalities will be given by = Sin=i 


M > 0 . 


^ n . A GEOMETRIC INTERPRETATION. REDUCTION TO ESSENTIALS 


The parametric solution just established means that the solutions 
occupy a convex polyhedral cone in n-space with the origin as vertex. The 
induction step corresponds to finding the subcone cut off by an additional 
hyperplane through o. Some basic rays are the same as before this step; 
others are obtained by joining two rays on each side of the hyperplane by 
a plane and cutting this plane with the hyperplane. It is not sijpposed 
that the base before this step contains a minimal number of rays, and even 
if this is the case the use of all pairs of rays as indicated is likely to 
Introduce many superfluous rays in the new base. It is clearly desirable — 
and for mamerlcal confutations even imperative --to have a shortest des¬ 
cription of the polyhedral cone and to stay with it during the whole 
procedure. 

First consider a pointed polyhedral cone (that is, a cone not 
containing a straight line, or equivalently a cone with a unique vertex) in 
n-dlmenslonal space and not in a lower-dimensional space. Here a concise 
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description consists of an enumeration of the extremal rays, that is, those 
rays which are not between any two rays of the cone, and of the hyperplanes 
containing the (n-l)-dimensional faces of the cone. These extremal rays 
and hyperplanes are uniquely determined by the cone, and the double and 
self-dual description consisting of their coordinates and coefficients, 
respectively, furnishes much of the useful information needed to determine, 
for Instance, maximizing rays or hyperplanes, the dual cone, the intersec¬ 
tion and convex hull of two cones, the extension of the cone by an addition 
al ray, and dually, as in the above induction step, the common part of the 
cone and a half space. 

If the cone while still n-dimensional contains a maximal linear 
variety, say of d dimensions, the description will be the same as far as 
hyperplanes are concerned but the rays indicated will fall into two subsets 
the central part and the extremal part . The central part describing the 
linear variety will consist of d + l rays a^, a^, ..., a^ or perhaps 
more conveniently of d pairs of opposite rays a^, -a^, ..., a^, -a^. 

The extremal part will contain one ray for each (d + 1)-dimensional face 
of the cone. Every ray of this kind is only determined modulo an arbitrary 
vector of the d-dimenslonal variety of vertices. 

If the cone has less than n, say 1, dimensions this will not 
affect the description by rays. But now the hyperplanes will fall into a 
central part and an extremal part. The central part (n-l hyperplanes) 
describes the smallest linear variety containing the cone. Every highest- 
dimensional face within this variety is singled out by one hyperplane in 
the extreme part. 

The full double description scheme at every stage looks like 


this; 

C 

D where A, B, C, D, M, and the 0*s are matrices 

A 

0 

0 

B 

0 

M 


Each row of A contains the coordinates of a ray of the central part, 
while the rows of B give the rays of the extremal part. Every column 
of C consists of the coefficients of a hyperplane of the central part, 
while D is in the same way composed from those belonging to the extremal 
part. In the intersection of each row of A or B and each column of C 
or D stands the scalar product of both, which is always non-negative. 

A and C consist of those rows and columns respectively for which all 
scalar products in which they enter are zero, since the rays of A lie in 
all hyperplanes, and the hyperplanes of C contain all rays. Thus M has 
no zero row or colTimn. 

Two rows of B correspond to adjacent (d + 1)-dimensional faces 
of the cone if and only if the entire set of columns of D for which both 
give zero product does not simultaneously give zero products for any other 
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row of B (of. page 63 ). In fact two faces of lowest dimension are 
adjacent If and only If the dimension of the face joining them exceeds 
their dimension by one unit only, and If and only If this joining face con¬ 
tains only the two given faces. 

To reduce the case of Inhomogeneous Inequalities to the above 
scheme, homogenize by writing an additional unknown % beside the con¬ 
stants and adding the Inequality | > 0 . The points with ^ = 0 lie In 
the hyperplane at Infinity. 

Now suppose that a full double description has been obtained at 
a certain stage, and a new step Is to be taken corresponding to a hyper¬ 
plane H. We write the coefficients of H as an additional column next 
to C and D and compute the Inner products with the rows of A and B. 

If the products Involving H are all non-negative, then the cone defined 
by H and the hyperplanes of C and D Is the same as the cone defined 
by C and D above, which by supposition Is fully described. Hence H 

Is superfluous (It either gives no face at all or a face already Indicated) 
and should be omitted. 

Secondly, If the products Involving H and rows of A are all 
zero, while there exist rows of B for which the product Is negative, each 
such row should be thrown out. However, before throwing a row out it 
should be combined with each row of B corresponding to an adjacent face, 
as explained before, and giving a positive product. By combining we mean 
determining the intersection ray of the plane corresponding to the two rows 
and of H and writing the row obtained as an additional row to B. The 
determination can be effected by the formula Pj^^ I bj^ I + Pj^^ I b^ | of 

Section 10 , or as In the computing instruction below. 

Finally we have to consiaer the case where not all products of 
rows of A Involving H vanish. We choose as normal form of A a des¬ 
cription by d pairs of opposite vectors; hence the product with H Is 
positive for a certain row a of A (If there are several such rows 
choose one). Then one has to: 1 ) delete a and -a and adjoin a to B; 
2 ) delete every row a* a of A giving a positive product while re¬ 
placing -a* by Its "combination" defined as before with a and by the 
negative of that combination; 3 ) replace every row of B giving a negative 
or positive product by Its combination with a or -a, respectively. 

^ 12 . SPECIAL CASE: x = 0 

If the Inequalities x, = 0, x^^ ^ 0 occur in the given 

system, as for Instance In the game case treated In Parts I and II, these 
Inequalities can be taken first and since their solution is the positive 
orthant, d Is already zero, the central part A Is void and the last- 
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mentioned possibility in the procedure of Section 11 does not occur. If 
we suppose that the given system is non-degenerate in the sense that no 
n + 1 of the (inhomogeneous) linear functions vanish at the same point, 
which is always the case after a small change of the coefficients, then 
also the condition for adjacency takes on an especially simple form and a 
computing instruction for such a system would be as given below. 

The confutation at the end (see Tables II and III) concerns a 
submatrix of the diet-matrix in [9]. In this exanfle the matrices A and 
C of the schematic diagram above are absent. The rows L i, ..., L n 
(L 1 represents the i-th row below L), corresponding to the inequali¬ 
ties > 0, ..., Xj^ > 0, are the Initial entries in the matrix D which 
is written as rows rather than columns for convenience in tabulation. The 

additional rows L n + l, . .., L n + h of D, corresponding to the other 

given inequalities, are used successively in the confutation. The entries 
in L n + h + 1 are the coefficients of the function to be minimized. 

Column 0 of the table contains the constants of the linear inequalities 
and, below P, the homogenizing coordinates of the vertices. Coliimns 1 
through 6 contain the coefficients of the linear inequalities and of the 
function to be minimized and the coordinates of the vertices. 

The rows Pi, ...,Pn+1 (Pi means the 1-th row under P) 

constitute the matrix B at the beginning of the confutation. During the 

confutation rows P n + 2, ... are Incoiforated in B, while some P-rows 
may cease to belong to B- The scalar products in the matrix M used in 
the confutations appear in columns n+ 1, ..., n+h+ 1. The arrows 
indicate the correspondence between the L-rows and these latter columns. 
Columns -3, -2, and -i are used to record labels and side calculations. 

The final polyhedron is described by B in its final form, 
namely, it has vertices Pi to P 35 except Pl,P8, Pio,pii, 

P 12, P 20; and by D in its final form, namely, by the five-dimensional 
sides L 0 to L lO except L 8, where L o denotes the hyperplane at 
infinity. 

Since row P 19 gives the smallest value in column il, it is 
the only solution of the minimization problem. 

ABBREVIATIONS. L 3 means the third row below L. 

P 3 means the third row below P. 

P 3 7 means the number in row P 3 and column 7* 

0RI3ER OP STEPS. Perform step 1 A, then all steps l B, then 
step 2 A, then steps 2 B, step 3 A, ..., until step h B. 

STEP s A. Compute entries P k n+s in the n+s^^ column as 

far down as possible by formula 1, except that if P k o = o write 

P k n+s ~ oo; and omit P k n+s if P k n+h+1 is an x. 

STEP s B. For every k for which P k n+s < o and for every 1 
for which P 1 n+s >0 or P 1 n+s = », and for which P k and P 1 
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TABLE II 


have n-1 common zeros perform substep n+s k 1. When throiigh all sub¬ 
steps n+s k 1 belonging to the same P k n+s < 0 (there may be none at 
all), make an x in P k n+h+1 and in all free places in columns n+1 
to n+h+1 in row P k. 

SUBSTEP n+s k 1. Start a new row by its number, say m, in 
column -4. Wrtie k in column -5, 1 in column -2, and 

1000 |P k n+s|/(|P k n+s| + P 1 n+s) in column -1 (to be omitted if 

P 1 n+s = oo); write looo in column o (n.b., we multiply our computa¬ 
tions by 1000 to avoid decimals); and write 0 in each of the n-T col¬ 
umns in which P k and P 1 have common zeros and in column n+s. The 
remaining P m j, j == 1, ..., n, con^jute by formula 2, except that if 

P 1 n+s = CO, use formula 5- (Other entries in row P m coming before col¬ 
umn n+s are unnecessary for subsequent calculation and are marked by an x.) 

FORMULA 1 . P k n+s = (P k 0 . L n+s 0) + (P k 1 . L n+s 1) 

+ ... + (P k n . L n+s n) . 

FORMULA 2. P m j * P k j + l/l000[P m (-1) {P 1 j - P k j}]. 

FORMULA 3- P m j « 1000 |L n+s 0| / L n+s j unless L n+s j = 0 

in which case write P m j = 1000 |L n+s 0|. 
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SOLUTIONS OF CONVEX GAMES AS FIXED-POINTS’ 

M. Dresher and S. Karlin 

f 1. INTRODUCTION 

In a game with a finite nijinber of pure strategies the choice of 
a mixed strategy is equivalent to the selection of a point in a aln^lex. 

If the strategies are constrained in any way, then the choice is no longer 
made from a siirplex but from an arbitrary convex set. Many infinite games, 
e.g., polynomial and polynomial-like, are essentially finite games over 
general convex sets since the choosing of a mixed strategy is equivalent to 
choosing a point in a finite dimensional convex set. 

In this paper we stuay games played over arbitrary convex sets. 
Interpreting the solutions of a game as the fixed-points in a continuous 
mapping, we obtain some general results on the dimensionality and continui¬ 
ty of solutions. Dimensional relationships for games played over slii 5 )llces 
were first derived in [1] and [3]. Some dimensional and continuity rela¬ 
tionships for polynomial-like games were first obtained in [ 2 ]. The gen¬ 
eral convex game treated here can be formulated as a polynomial-like game 
by spanning the convex set with a Peano space-filling curve. However, the 
complicated nature of such a curve makes this formulation impractical for 
theoretical and computational purposes. We also describe a method of com¬ 
puting the solutions by mapping one convex set onto another. The method is 
applicable to both finite games and infinite games with polynomial or 
polynomial-like payoffs. 


^ 2 . CONVEX GAMES 

We define a finite dimensional convex game as follows; Player I 
chooses a point r = (r^, •••» from a convex set R lying in 

Euclidean m-space. Player II chooses a point s = (s^, 3 ^, ..., s^^) from 
a convex set S in Euclidean n-space. R and S are bounded and closed. 
The payoff from Player II to Player I is given by a bilinear form 


^The preparation of this paper was sponsored by The RAND Corporation. 
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(1) A(r,3) - Xj^ = 2^1=1 + 8o<®) *= 

where f(r) and g(s) are linear functions of r and s, respectively. 

If Player I has m pure strategies and Player II has n pure 
strategies, then R and S are (m - 1)-dimensional and (n - 1)-dimen¬ 
sional slraplices, respectively, and A(r,s) is the mixed strategy payoff 
to Player I. However, if a game has a finite ntimber of pure strategies and 
the mixed strategies are subject to some finite number of linear constraints, 
then the sets R and S are polyhedral convex sets. If a game is con¬ 
tinuous and the payoff is polynomial-like, l.e., the payoff to Player I 
from Player II if they choose pure strategies x and y, respectively, 
is given by 


M(x,y) 

where r^ and s. are continuous functions, then R is the convex set 
^ J 

spanned by the curve 

^1 “ ^i^^^' 0<x<l, l=i,2,...,in, 

traced out in m dimensions, and S is the convex set spanned by the curve 
Sj = Sj(y), ° j = l> 2, ..., n, 

traced out in n dimensions [2]. The payoff A(r,s) is given by (l). 

^ 5. SOLUTIONS OP CONVEX GMES 

The existence of optimal strategies r^,s^ and a game value v, 

such that 

(2) max A(r,s^) = rain A(r°,s) = v 

r^R sGS 

can be established in two fundamental ways. We may use properties of con¬ 
vex sets, specifically the result Uiat two non-overlapping convex sets can 
be separated by a hyperplane. It also follows from the Kakutanl fixed-point 
theorem [h]. 

The optimal strategies (one set for each player), or solutions 
are the generalized fixed-points in the upper semicontlnuous mapping de¬ 
scribed as follows: Let r® G R. Define the image of r^ on S to be the 

set of points S(r^) C S where min A(r®,s) is assumed.- S(r^), which is 

sGS 

the intersection of a hyperplane with the boundary of S or coincides with 
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S, Is a convex set. Let s® G S and let the Image of s^ on R he the 

set of points R(s^) C R where max A(r,s^) Is assumed. If r^ G R(s°) 

- 

and s° G S(r^), then r^,s^ satisfies (2) and is therefore a solution of 
the game. Further, since r^ is an Image of s^ and s^ Is an image of 
r^, r^ and s^ are fixed points in R and S, respectively. It is 

clear that if R^,S^ are the sets of optimal strategies of the two players, 

then every point of R^ is an image of every point of S^ and every point 
of S^ is an image of every point of R^. 

We can also formulate the solutions as fixed-points of the 
point-set mapping F which takes a point (r,s) in the product space 
R®S into the non-void set (R(3),S(r)) = P(r,s) in R®S, where R(s) 
and S(r) are defined above. 

^4. CONTINUITY OP SOLUTIONS 

To develop the theory of convex games, we first study the solu¬ 
tions for continuity. The following theorem, first proven in [2], is 
repeatea for completeness. 

THEOREM 1 . The solution of a convex game is a 
lower semi-continuous function of the payoff. 

PROOF. Let G be an open set containing the optimal strategies 
R^ of player I in the game with payoff A = A(r,s). Suppose each element 

of A is perturbed by at most E, let denote the resulting payoff 

and denote the set of optimal strategies of player I. We assert that, 

for a sufflcienLly small E, R^ is in G. For, let us assume the contrary. 
Then there exists a sequence tending to zero with a corresponding 

sequence of payoffs A^ such that each R^ is not contained in G. Let 

r^ be in R^ but not in G. Since R is compact we may suppose that 

r^^ tends to r as n oo, where r is not in G but in R. Further, 
it is readily verified that a limit point of optimal strategies for the 

payoffs is an optimal strategy for the payoff A. But r is not in 

^ 0 

G and hence not in R and so we arrive at a contradiction. 

By an identical argument one can show that if the strategy spaces 
Rj^ converge to R, then the sets of solutions are lower semi-continuous. 

A set of spaces R^ is said to converge to R if every point of R is a 

limit point of points of R^^ and there exist no other limit points of 
points of . 
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{ 5. GAMES WITH UNIQUE SOLUTIONS 

In this section we derive a dimensional relationship for games 
with unique solutions. It Is shown that the relevant property of the 
polyhedral face containing the optimal strategy Is the dimension of the 
face rather than the number of vertices. 

Let r^,s^ be the unique solution of the game with payoff 
A(r,s) over the strategy space (R,S). Assume that R and S are poly¬ 
hedral convex sets. Let r^ be Interior to a k-dlmenslonal face R^ of 
R, and s^ be Interior to an 1-dlmenslonal face S^ of S. R^ and S^ 
are polyhedral faces. Since s^ Is optimal. It maps onto some maximal 
face r'^R^- Similarly, r® maps onto some maximal face s' ^ • 

LEMMA 1. The game with payoff A(r,s) over the 
reduced strategy spaces (R ,S ) has the unique solu¬ 
tion r^,. 

PROOF. Since r^ maps onto S* ^ S*^ ^ s^ and s° maps onto 
R * R^ => r^, It follows that Is a solution of the game over the 

II » » 

strategy space (R ,S ). To show It Is unique, let us assume that s G S 
Is another optimal strategy for Player II. Then s maps onto some face 
containing R^. Let s = £s' + (1 - fe)s^ be a solution close to s^, and 
therefore maps onto a face containing R^. Now for the original game over 

I Q 

(R,S) we defined R as the maximal face upon which s maps. Hence a 
point s sufficiently close to s® will map Into some part of R con¬ 
taining r®. Therefore s Is another solution of the full game, which 
contradicts the uniqueness assumption. 

We may now confine ourselves to the reduced polyhedral game over 
(R*,S*). In this game r^ Is Interior to R^, and r^ maps onto S 
Similarly, s^ Is Interior to and s^ maps onto R* . 

LEMMA 2 . If r^,s^ is the -unique solution of the 
polyhedral game (R ,S ), then 

n * 0 » 

R^ * R and S^ * S . 

0 * 0 * 
PROOF. Suppose s Is on the boundary of S , or S C S . 

I 0 

Consider a sequence S^^ of polyhedra Interior to S excluding S which 
expand out to all of S as n increases. We can construct S^^ by using 
any Inner point c of S and taking the set of all points on the segment 

° ^ 


Ac + (1 - A)x 
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t 

and X any point of S . 

Consider the game over the spaces (R ,S^). Let (X^, de¬ 

note the solutions to this game. Then from the lower semi-continuity of 
the solutions it follows that every sequence of solutions s^ tends to 
s^. Now since r° is interior to R^, then for n sufficiently large 

the solutions r„ lie interior to a polyhedron having Bp as a face. 

^ 0 
Therefore, for n large, s^ maps into a polyhedron containing R . But 

r^ maps into all of S*, it follows that is a solution of the 

game over (R*,Sj^). It also follows that Is a solution of the 

game over (R*,S*). This contradicts the hypothesis, since s^^ is in¬ 
terior to s’. Therefore S* = S°, and similarly r' = R®. 

REMARK. Using a similar argument, we can generalize Lemma 2 to 
games with non-unique solutions. Let R^ be the smallest polyhedral face 
containing the set of solutions of Player I. Now every optimal strategy 
of Player II will map onto some polyhedral face of R; some of the optimal 
strategies will map onto R^. Let R be the maximal intersection of 
these polyhedral faces. Then, by an argument Identical to above, it can be 
readily shown that R* = R^. Similarly, if S^ is the smallest polyhedral 
face containing the optimal strategies of Player II, and S is the inter¬ 
section of all polyhedral faces into which are mapped Player I*s optimal 
strategies, then s’ = S^. Again, we may confine ourselves to the reduced 
game over the space (R^,S°). 

THEOREM 2. If a polyhedral game has a unique solu¬ 
tion, then the two optimal strategies lie in polyhedra 
of the same dimension. 

PROOF. Since r° maps into an 1-dlmensional polyhedron in S, 
we must have 


= ° j = 1. 2.1. 

or some 1 linear relations must be satisfied. These relations determine 
a manifold of points in R mapping onto S^ and having dimension, at 
least, m - 1. Now the manifold and the k-dimenslonal polyhedron have only 
r® in common, otherwise the uniqueness of the solution would be contra¬ 
dicted. Therefore, 


m - 1 + k ^ m 


or 


k < 1. 
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Similarly we can show 1 < k, and therefore k « 1. 

i 6 . GAMES WITH MANY SOLUTIONS 

We can reduce the general case of polyhedral games with many 
solutions to the special case of games with unique solutions. Suppose X, 
the set of optimal strategies of Player I, is k-dimenslonal and is in¬ 
terior to a polyhedron, R°, which is u-dlmensional. Suppose Y, the set 
of optimal strategies of Player II, is i-dimensional and is interior to a 
polyhedron, S^, which is v-diraensional. 

THEOREM 5- For any polyhearal game, the set of 

solutions and their containing polyhedra satisfy the 

dimensional relationship 

u - k = V - 1. 

PROOF. We have shown tliat X maps onto S^ and Y maps onto 
. Consider the reauced game over the spaces , S^. Tde payoff now 
becomes 

A(r,s) = “ Sl=l Sots). 

The common zeros of f,(r), f 2 (r), .... f^(r) in R° correspono to the 
optimal strategies oV Player I and the coinmon zeros of g^Cs), gjp(s), ..., 
g^(s) in S^ correspond to the optimal strategies of Player II. 

Form the factor space of E^/ X^, where is the Eucliaean 

space containing R^ anc X^ is the linear extension of X in E^. By 
taking a cross section T in E^ perperialcuiar to the manifold X, the 
polyhedron R^ becomes a new polyhoaron in T. Since X was interior 
to R^, then X becomes a unique interior point r^ of T. In a similar 

way we construct the factor space eV and by taxing a cross see tLon, 

the polyhedron S^ becomes a polyhedron U ana Y beoonjes a unique in¬ 
terior point s^. We obtain the induced mappings of f^, f^, ..., f^ 

and g, , gp, • • •, g,, on T to U, wtiich are well definea. 

^ 0 0 

For this mapping it is clear that r , s are optimal strategies, 
as X^ and Y^ constitute the zeros of f^^ and gj, respectively. They"' 
are also unique, since any other strategy r» of Player I must cover all 
of T and hence must be a common zero of the induced mappings f ^ , 

fg^ •••, f^- In terms of E^, this inplles that r' belongs to the 

coset X^. Prom Theorem 2 it follows that 


dim T = dim U 
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or 


u - k = V - 1. 


^ 7. UNIQUENESS OP SOLUTION AND PERTURBATION OP PAYOPP 


We shall demonstrate that If a finite polyhedral game has a 
unique solution, then for any sufficiently small change in the payoff the 
solution remains unique. 

Let the solution r°,s° of a polyhedral game be interior to 
a k and 1 dimensional face R^ and S^, respectively. We have proven 
that k = 1. Let T be the manifold of all points in R mapping into 
S°. Then T is defined by 1 linear relations, say 




m 

1=1 




0 , 


j = 1, 2, ..., 1 


where 
T be 


w, 


is a linear function of the matrix 
then 


A. 


Let the dimension of 


w > m - 1. 


Since 


T and R° 


intersect in a unique point 


we have 


m>w + k~w + l. 


and thus 


w = m - 1. 

The last relationship Inplles that the matrix f'ull 

rank. If the payoff Is perturbed by a sufficiently small amount, the di¬ 
mension of T will not change — the rank is preserved. We can also 
preserve the rank of the intersection of the manifold T and bP • There¬ 
fore we can obtain an (m - 1)-dimensional manifold which intersects R® 

I t 

in a unique point r . In a similar way we can obtain a unique point s 
in S°. Since r* and s' are unique points of intersections, it follows 
that r*,s* is the unique solution of the game with the perturbed payoff. 

If the game is a general convex game, not necessarily polyhedral, 
then the uniqueness of a solution is no longer preserved under small per¬ 
turbations. Por example, in the game with payoff M(x,y) * xy - x^, both 
players have unique optimal strategies lying on the boundaries of their 
respective spaces. If the payoff is perturbed to xy - x^ + ex, the 
uniqueness is destroyed. However, if both players possess interior unique 
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optimal strategies, then the planes f j(i^) ~ o intersect in a \mique in- 
terior point and the planes gj_(s) « o also Intersect in a unique interior 
point, and small perturbations of the payoff preserving this intersection 
property will preserve the uniqueness as well. 

^8. INTERIOR AND "IDENTICALLY v” SOLUTIONS 

We can interpret geometrically two general types of solutions: 

1. Solutions interior to R and S. 

2. Strategies which yield identically v to a 
player independent of strategies of the other 
player. 

Let be an Interior optimal strategy of Player I and 
some optimal strategy of Player II. Then s^ maps onto a set R(s^) 
containing no interior point of R unless gj_(s^) = o for all i. There¬ 
fore every optimal strategy of Player II is on the intersection of the 
planes gj^(s) = O, and thereby yields Identically v. The Interior solu¬ 
tion, r^, of Player I need not have any special position relative to the 
planes = o. However, an optimal strategy r^ yields identically v 

if and only if it lies on the common portion of all the planes = 0* 

9 . SYMMETRIZING A CONVEX GAME 

A finite convex game can be symmetrized in a manner similar to 
the slnplex game. Let the payoff be represented by 

(Ar.s) - ( Xl=l 


Define 


p(rn^®o) “ (Ar,s«) - min (Arf^,s). 

^ ^ rGR ^ sGS ^ 

It can be verified that p(rQ,SQ) > o, for all ~ ° 

if and only if (rQ,SQ) is a solution of the game. Furthermore, 


(Ar,So) + max (r«,-A*s) 
° ° r^R ° sGS ° 

« max [(Ar,s^) + (r^,-A*s)]. 
rGR ° ° 

sGS 


Form the product space = Ej^®Ej^ and the product convex 
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set RgS. Consider the linear operator IA,-A*} lr,s) defined over 
The payoff over the product space becomes 

((A,-A*) (r,s), (sQ,rQ)) = (Ar,SQ) + (rQ,-A's). 

This is a symmetric game In which Player I picks (r,s) and Player II 
picks (s,r), each from the space R0B. The solutions of this symmetric 
game are those which p(rQ,SQ) * 0 . 

Every finite convex game can be symmetrized to a new convex game 
in (n + m)-dimensional space whose payoff matrix is given by 



and where both players choose points from the product set I@B. If R 
and S are both simpllces, then R0S is no longer a simplex. In order 
to play on a simplex set it is necessary to add an extra dimension. 

^10. COMPUTATION 

We can compute the set of solutions R^,S® by an orderly exami¬ 
nation of the spaces R and S for fixed-points in a continuous mapping. 
The method consists of dividing the space R into a finite number of con¬ 
vex subsets R^, Rp, • • •, Rdk by nieans of the hyperplanes fj(r) « 0 , 
j = 1 , 2 , ..., n, and the boundaries of S, and similarly dividing the 
space S into a finite numbe;? of convex subsets S^, Sg, by means 

of the hyperplanes g^(s) = 0 , 1 = 1 , 2 , .. ., m, and the boundaries of R. 
The division of R is such that each of its subsets R^ maps onto some 
maximal boundary of S and each of the subsets Sj maps onto some maximal 
boundary of R. The subsets, R^^, will overlap, but their union is the 
full strategy space, R. Prom the previous discussion, it follows that 
R^,S^ are the fixed-points in the mappings of R^, Rg, ..., R<^ onto S 
and 3 ^, 82 , ..., Sp onto R. Further, R® = R^^ for some 1, and 
S® = for some j. 

We illustrate the method by two examples — first, a game with a 
finite number of pure strategies, and second, a game with a continuum of 
strategies with a polynomial payoff function. 

example 1 . FINITE GAME WITH CONSTRAINTS 

Let the payoff corresponding to the pure strategies be defined 
by the matrix 
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/ 3 39 30 \ 

f 33 9 0 I 

\28 4 25 / 

We wish to determine the optimal strategies if the mixed strategies are 
subject to the following additional constraints: 

1 < lox, <8 1 < lOyg < 20y, 

1 < 20 x 2 <10 ’ 1 

18 - 4ox, < i5Xj. 

From the constraints it is evident that R is a pentagon and S is a 
triangle. We may write the payoff as follows: 

A(x,y) = (loxg - lox, + i)y, + (lOXg + lox, - T)y 2 + jCsx, - 25 X 3 + 25 ) 

= (-lOy, + lOyg + |)x, + (lOy, + lOyg - •^)x 2 + (y, - Tyg + 

= Piy, + Pays + Pj “ * '92*2 ' 93 - 

We now divide the spaces R and S Into the following convex 

sets: 

R, (p, > 0 , P 2 > o)> RgCp, > 0 , P 2 < 0 ). Rj^Pi < o» Ps > 

R^Cp, < 0 . Ps 1 ' S^Pi = P 2 1 = Pg = 0 ). 

S, (q, > 0 , Qg < 0 ), S 2 (qi < 0 , q 2 > 0 ), SjCq, = 0 , qg < 0 ) 

Si,(q, = qg = 0). 

Some of these sets may be void, in which case they will not 

appear in the later mappings. Some of the sets overlap. Mapping each 

into S and each S . into R, we have 
J 

R, >.(S,)—^(R,), Rg—»(S,)—^{Rj), Rj—>(Sg) —♦(Rg) 

Rl^-^(Sg)-?(Rg), R 5 - 

where (S,) represents a point In S, and (Rj) Is a point In R^. 
Therefore R° = R^ and S° - or the qptlmal strategies are given by 
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2 

“ 5 ' 

-j-c X < ^ 
20 1 *2 i. 10' 

X^ 1 - X^ - X2 

yi 

1 

2 ' 

Yg = 5 . 


The value of the 

game is 

V = 19 . 5 . 


EXAMPLE 2. 

INFINITE GAME 

WITH POLYNOMIAL PAYOFF 


Let the pure atrateg;y payoff be given by 

M(x,y) = 21x + l8x^ - 2 kx^ - l6y - 36 xy - 9x^y + 18x^y + 60 y^ - 36 y^ 

where o<x<l,o<y<l. If P(x) and G(y) are mixed strategies of 
the two players, define 


dF(x) 


■l- 

Jj yl«(y) 


i = 1 , 2, 3 

j = 1, 2, 3. 


The mixed strategy payoff becomes 


A(r,s) = 2lr^ + I 8 r 2 - 2i+r^ - l 6 s^ - 56r^s^ - ^^ 2^1 + 60^2 ’ 36sj. 

R, the strategy space of Player I, is a 3 -dimensional solid whose boundary 

2 

consists of the curve C (defined parametrically by r^ « t, r 2 = t , 
r^ = t^, 0 < t < 1j lines connecting the origin with each point of C 
and lines connecting (1 , l , 1 ) with each point of C. S is defined in 
exactly the same way (S is the convex hull of the curve defined by 
s^ = u, Sg « u^, s^ == u^ where o < ^ l) • 

Let 

f = -16 - 36r^ - 9r^ + I8r^, 

then we divide the spaces R and S into the following convex subsets 
R^(f<-28), R2(f>-28), R5(f=-28) 

S,( 3 , >|), SgCS, <|), 83(8, =|). 

We now have the following mappings of R onto S and S onto R: 


( 1 , 1 , 1 ) 
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Rg—= 

Rj— *p{^, + (' - /») (1» 1. O where o < ^ < i 


S,—»>( 0 , 0 , 0 ) 



Sj—»<*(|, If, 5 ) + (1 - ‘^)(o, 0 , 0 ) where 0 < <* < 1 . 

From the above, it can be verified that 

Rj->83—^Rj If ct = |, / = i. 

This yields the unique solution 

P*(x) = i Iq(x) + I I^(x) 

2 

G*(y) = \ ii_(y) + ^ I, (y) 

3 

where is a st^-function with a jump at a. The value of the game 

cl 

is V = 6. 
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AmiSSIBLE POINTS OF CONVEX SETS 
K. J. Arrow, E. W. Barankln, and D. Blackwell 

. SUMMARY 

A point s of a closed convex subset S of k-space is admissi ¬ 
ble if there is no t G S with t^ < s^ for all i=l, ...k, t^s. An 
example is given in which the set A of admissible points is not closed. 
Let P be the set of vectors p = (p^ , .•*, Pj^) with p^ > 0 ,'^^ Pj^ = 1 » 

let B(p) be the set of s G S with (p,s) = min (p,t), and let 

tGS 

B = 2Ib(p) , so that B consists of exactly those points of S at which 
there is a supporting hyperplane whose normal has positive con^jonents. 

THEOREM 1 . B C A C B. If S is determined by a 
finite set, there is a finite set p^, pj G P, 

such that B ~ Sjfi B(Pj), so that, since B(p) is 
closed for fixed p, B = A = B. 

That B C A C B when S is determined by a finite set was 
noted, in the language of convex cones, by Gale [2].^ 

A consequence of Theorem i is that, in a two-person zero-sum game 
in which each player has only a finite number of pure strategies, every 
pure strategy which yields the value of the game against every mlnimax 
strategy of the opponent enters with positive probability into some mlnimax 
strategy, a result due to Bohnenblust, Karlin, ana Shapley [1]. 

i2, PROOF OF THEOREM 1 

Suppose first that S is bounded. If s G S, s $ A, there is 
a tGS with t^ < s^ for all i and t ^ s. Then (p,t) < (p,s) for 
every p G P, so that s $ B. Thus B C A. 

To show that A C B, let a G A. We may achieve 


^Numbers in square brackets refer to the bibliography at the end of the 
paper. 
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a«(o,o, ...,0) by translating the coordinate system. For any 
0 < g. < p let P(t) be the set of p G P with > «■ for 
1 « 1, ..T, k. For any two closed bounded convex sets R,S of k-space, 
there are vectors r* G R, s* G S with (r*,s) > (r*,s*) > (r,s*) for 
all r G R, s G S; this fact may be proved as follows. Let r^ G R, ^ S 

be sequences dense in R,S respectively. The finite game whose NxN 
matrix is (r^,Sj),l < i,j < N, has a value V(N) and good strategies 
(\l, thus If r*jj=Sifi 

Sj,* ^ ^ ^ 1 

Letting N —> *» through a subsequence for wliich rjj*,Sj^* converge, say 
to r*,s*, yields (r*,Sj) > (rj^,s*) for all i,j, and r*,s* have the 
required property. We apply this result to P(i),S, obtaining 
p(£) G P(£), s(g.) G S such that (p(e),s) > (p(£), s(€.)) > (p,s(£)) for 
all p G P(£.), s G S, and note that (p(g.), s(£)) < (p(£), a) = o. Choose 
a sequence —* 0 for which s(£^) converges, say to s* G S. For all 

P G P, (p,s(£^)) < 0 for sufficiently large n, so that (p,s*) < o. 

Thus sj < 0 for all i and, since a = (0, 0, ..., 0) is admissible, 
s* = a. Finally s(£j^) G B(p(£^)) C B, so that a G B. 

For unbounded S, we use the 

LEMMA. Let C be a convex set, N a neighborhood, 
and Sq minimize (p,s) for s G C A N. Then s^ 
minimizes (p,s) for s G C. 

PROOF. Suppose, for some s^ G C, (p,s^) < (p,Sq). Let 
®2 ""^*"^0 ; for 0 < < l , s^ G C, (p,S 2 ) < (p^Sq) • But for ck 

sufficiently small, s^ G N, which contradicts the hypothesis. 

It follows from the Lemma that Theorem 1 holds without the con¬ 
dition that S be bounded. Let S be any closed convex set, a an 

admissible point of S. Let N be a closed neighborhood of a. Then a 

is admissible in S H N. By Theorem 1 , a = lim s^^, where s^^ minimizes 

n-*oo 

(Pn,s) for s G S n N for some p^^ in P. Then, by the Lemma, s^ 

minimizes (p^^s) for s G S for the same p^. 

Now suppose Uiat S is determined by a finite set s^ , ..., s^^^. 

A subset U of s^, ..., s^ will be called usable if there is a p G P 

for which U C B(p) . Let , •.., Uj^ be the usable subsets of 

s^, ..., and let p^, .. •, Pjj be corresponding p's, so that 

U. C B(p .)- Let s G B, say s G B(p), s =V^ Then if U is the 

J J 

set of s. for which > 0, U C B(p), since (p,s.) > min (p,t) for 
^ ^ ^ tGS 

s^ 6 U would imply (p,s) > min (p,t). Thus U is usable, 

^ ^ ^ „tts 

say U = Uj. Then s £ B(pj) and B B(pj). This conipletes the proof. 
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^ 3. AN EXAMPLE 

If k = 2, it is easily shown that A is closed; in our exairple 
k “ 3 and A is not closed. Let U be the closed arc consisting of all 
points (x,y,1) with (x - i)® + (y - 1 )^= 1 , 0 < x,y < 1, let 
e - (1,0,0), and let S be the convex set determined by U and e. The 
point f= (1,0,1) GS is not admissible; we show that every point 
®o “ ^o'^o ^ ° (Xq - 1)^ + (y^ - 1)® = 1 Is adrals- 

slble, in fact, that it is an element of B. 

There is a vector p^ = (^q^v^,o) with > 0 , > o, 

^0 ^ such that (Pq,s) > (Pq,s^) for all s G S, s ^ s^. Let 

P * (1 - £)Pq + e(0,0,l), 0 < €. < 1 . Then p G P, and 

(p,s) = (1 - G.)(Pq,s) + g. for s G U, so that (PjSq^ ^ (P#s) ^‘or 

s ^ Sq, s G U. Also (p,e) « (1 - G:)(p^,f) > (l - €.)(Po*Sq) + € = (p^s^) 
for £. sufficiently small. Thus s^ G B(p) for g, sufficiently small, 
completing the proof. 

We remark Incidentally that e G A but e ^ B, so that 
A 7 ^ B, B ^ A in our example. 

^ 4. AN APPLICATION 

A consequence of our theorem is the i'ollowing result of 
Bohnenblust, Karlin, and Shapley [1]. 

THEOREM 2. Let A = | I be an m x n matrix, 

consicerec as the payoff of a zero-sum two-person game, 
and let D be the set of all 1 for which 
A(i,q) = ^ij^j every mlnimax strategy q 

for II, where v is the value of the gamu. Then 
there is a minlraax strategy p for I with Pj^ > 0 
for 1 G D. 

PROOF. If we delete from A the rows for which i $ D, the 
resulting game has value v, ana every miniraax strategy for I in the new 
game is mlnimax in the original game. Moreover A(i,q) = v for every 
i G D and every miniraax strategy q for II in the new game, for if 
Ado^Qo) ^ V for some i^ G D and some minimax q^ in the new game, 
A(lQ,q*) < V for every ^ > 0, where q* = + 0 - g)q^ ana q^ is 

minimax in the original game. Since q^ may be chosen so that 
A(i,q^) < V for i $ D, q* will be mlnimax in the original game for 
sufficiently small & > 0, and i^ $ D. Thus we may suppose i G D for 
i == 1 , ..., m. 

Let S be the convex set in m-space determined by the columns 
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of A. The point Sq * (v, v, v) G S and Is admissible, so that, by 

Theorem l, there is a p G P with s^ G B(p). That is, 

(PiSq) * V < (p,s) for all s G S. Thus p is a mlnlmax strategy for I, 
and Pj_ > 0 for i G D. 

§ 5 . IMPLICATIONS FOR STATISTICS AND ECONOMICS 

Suppose we have a statistical problem with a finite number of 
possible states of nature. To each possible strategy of the statistician, 
there can be assigned a vector whose conponents are the risks of the 
strategy under each of the possible states of nature. Let S be the set 

of such vectors; S will be convex if mixed strategies of the statistician 

are admitted and closed under very general assunptions. Then if we define 
the distance between two strategies as the Euclidean distance between their 
risk vectors. Theorem i asserts that every admissible strategy is the limit 
of a sequence of strategies each of which is a Bayes solution against an 
a priori probability distribution which assigns positive probability to 
every state of nature. If S is determined by a finite set (for example, 
if the sample size is boiinded, the variables observed take on only a finite 
set of values, and the number of actions among which choice is to be made 
is finite), then there is a finite set of such a priori distributions such 
that a strategy is admissible if and only if it is Bayes against one of 
these distributions. 

In an economic context, it is assumed that production is made up 
by carrying on different activities at varying levels of intensity. An 
activity is characterized by a vector a whose components are amounts of 
the different commodities passing through the activity, being positive for 
outputs and negative for Inputs. If the activity is carried on at level x, 
the amoxint of commodity 1 produced is xa^^ (which is negative for in¬ 
puts). If there are a finite number of activities a*^, then the amount of 
commodity i produced is Let commodities l, ..., k be final for 

desired outputs, k + 1, ..., m be primary inputs. If the negative of the 
total available supply of commodity 1(1 > k) is yj^^, then the activity 

levels X. must satisfy the conditions, 

J 

The image of this set in x-space under the transformation 

- 1, ..., k) is then the set S of all possible combinations 
of final commodities possible with the given technology and resource limita¬ 
tions. S is clearly closed, bomded and convex. A point s of S is 
said to be efficient if there is no t G S such that t^^ > for all 1, 
t ^ s. By Theorem l applied to efficient points, there is a finite set of 
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vectors p, with > o for all 1, such that s Is efficient If and 
only If s maximizes (p,s) for s G S for some one of those p's. The 
vector p can easily he Interpreted as a set of prices for the final 
commodities, and (p,s) Is the profit arising from the choice of activity 
levels leading to s. Hence, any efficient point can be arrived at by 
Instructing producers to maximize profits for a suitable set of positive 
prices. (See Koopmans [ 3 ], especially Theorem 4.3). 

In the more general case where the number of activities Is not 
finite, the activity levels will in general be replaced by a measure over 
the space of activities. The set S Is still convex, and, under suitable 
assu]iptlons, closed. Then Theorem 1 tells us that we can approximate any 
given efficient point arbitrarily closely by instructing producers to maxi¬ 
mize profits given a suitably chosen set of positive prices. 
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Part II 


INFINITE ZERO-SUM TWO-PERSON GAMES 


Among the zero-sum two-person games that have infinite sets of 
pure strategies available to the contestants, the "games on the unit square 
continue to attract the main attention. These games generalize matrix 
games by replacing the elements a^j of a payoff matrix by a real-valued 
function K(x,y) defined on the unit square 0<y<l. The 

pure strategics available to players I and II are indexed by the real 
niombers x and y, while their mixed strategies become probability 
distributions over the unit intervals 0 < x < 1 and 0 < y < 1 . This may 
seem entirely straightforward, but a large gallery of counter-examples has 
shown that such games can possess quite pathological deviations from the 
sound norm established by matrix games. So research continues in the 
direction of isolating classes of games on the unit square that will have 
suitably regular and manageable properties. 

The symmetric "games of timing" discussed by M. Shlffman in 
PAPER 6 can be Interpreted as duels in which the opponents have equal 
strategic resources. Their pure strategies, x and y, represent the 
times at which they act (the later, the better). Shiffman shows that an 
optimal strategy is characterized either as a density from some point a 
to 1 in the unit interval, satisfying an Integral equation with positive 
kernel, or as such a density combined with a junp at 0. Existence, unique 
ness, and method of construction of the optimal strategy are obtained 
thereby. The jump at 0 is excluded or not according as an eigenvalue of 
the Integral equation attains the value l or not. In certain cases, the 
integral equation can be replaced by a system of linear differential 
equations. 

In PAPER 7, S. Karlin continues the study of "games of timing" 
with the restriction to equal strategic resources removed. Even so, he 
finds unique solutions which consist of absolutely continuous distributions 
in the Interior of the imit Interval with possible juii5)s at the endpoints. 
The densities occur a-s solutions of certain integral equations and are 
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expressed either as Neinnaim series or as eigenfunctions of Integral 
operators. In addition Karlin solves another type of game In which the 
payoff K(x,y) is concave in each variable separately on each side of the 
diagonal x = y; the solutions are densities absolutely continuous over 
the closed unit Interval. (Some particular games of this type, called 
"butterfly games," in which the payoff is monotonic away from the diagonal, 
have been treated by I. Gllcksberg and 0. Gross.) 

The class of games considered by Karlin in PAPER 8 is a natural 
extension of the notion of convex game (see Study 2h, Paper 15)• The 
payoffs K(x,y) considered are assumed to have positive nth partial 
derivatives with respect to y. The author carries out a detailed analysis 
for n =* 1, 2, 3, ^ and shows that player I has an optimal strategy which 
is a step-function with at most n steps, while player II needs at most 
~ steps in some step-function strategy (jumps at the ends of the Interval 
being counted as half jumps). It is asserted that the theorem holds for 
arbitrary n. 

Polynomial games (see Study 2k, Paper ^k) form a class of infinite 
games that have finite-dimensional sets of mixed strategies, just as finite 
games do. But any hope that this characteristic might extend to games with 
rational payoff functions has been dashed by I. Gllcksberg and 0. Gross in 
PAPER 9, where they exhibit some of the pathology of such games. They 
match the known fact that polynomial games always have step-function solu¬ 
tions with an example of a game which has a continuous rational payoff but 
which has only densities as optimal strategies. This example Involves an 
Interesting application of Tarski's system of "elementary algebra." They 
also construct a rational-payoff example that has unique optimal strategies 
based on dense, countable sets. Finally, to point up the exceptional 
perversity of games on the square, they propose a method which constructs a 
game in C“ having an arbitrarily given pair of distributions as unique 
optimal strategies. 

PAPER 10 by D. Blackwell deals with a type of infinite game, not 
on the square, that has a statistical context. The payoff is a function 
L(tj, X, i), where u) is an element chosen by player I from a set SI, 
finite or infinite, x is a point chosen from a space X by a chance move 
defined by a probability measure P^ over X depending on oj, and i is 
an Integer chosen from 1,2, ..., k by player II, who is Informed of x 
but not of (0- A pure strategy for player II is a partition of X into k 
mutually disjoint sets, while a mixed strategy for II is a probability 
measure defined on such partitions. An alternative method of randomizing, 
directly related to Kuhn's "behavior strategies" (see Paper 11, this Study), 
is to assign a probability distribution on the integers 1, 2, ..., k for 
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each X In X. Blackwell shows that, from the point of view of payoff, 
these two methods of randomizing are equivalent to one another and to a 
denumerable mixture of certain canonical pure strategies. 

H. W. K. 

A. W. T. 




GAMES OP timing’ 

Max Shlffman 

SUMMARY 

We introduce the notion ol‘ a symmetric game of timing . It is 
defined here as a continuous game Involving the bilinear functional 

J Q J*Q K(x,y)dP(x)cLG(y) , K(x,y) = -K(y,x) 

in which for x < y, K(x,y) is a strictly increasing function of x and 
a strictly decreasing function of y (more precisely defined in 4 1 

< 0, there is an optimum pure strategy at l ; if K(o,l) > 0, 
there is an optimum pure strategy at 0. Aside from these trivial cases, 
it is proved that there is a unique optimal strategy which is either a 

density from some point a to 1, or is a jump at 0 and a density from 

a to 1 . If the quantity K(y“,y) varies in sign as y varies, let b 

be the value such ttiat K(b“,b) = 0, while K(y ,y) > 0 for b < y < 1 . 

In this case, the optimal strategy is a density from a to 1 where 
a > b. It is shown that the determination of the density function depends 
on the soiutioji of a certain integral equation with positive kernel, and 
the theory of such integral equations is discussed and applied. It is also 
shown tiiat for a general category of cases the optimal strategy can like¬ 
wise be obtained in terms of a system of ordinary linear dlfl'erential 
equations. 


4 1 . PRELIMINARIES 

We shall consider a class of symmetric continuous games involving 
the bilinear functional 



K(x,y)ciP{x)dG(y) 


^This paper was preparea as a report (Sept. 6, 19^9) for the RAND 
Corporation. 
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where x, y range over the real nunihers from o to 1 inclusive, the 
symmetry of the game reflecting Itself in the skew-symmetry of the kernel 
K(x,y): 


K(x,y) = -K{y,x) . 

Concerning the kernel K(x,y), we will suppose that for x < y K(x,y) is 
a strictly Increasing function of x and a strictly decreasing function 
of y . This property likewise holds for x > y by virtue of the skew- 
symmetry of K(x,y). But across the main diagonal x = y this property 
may cease, i.e., there may be a jump of K(x,y) and K(a+«J,a) may be 
smaller than K(a-J,a) for small positive iJ's. 

We shall call such a game a game of timing , by virtue of the 
following important interpretation. Ttie variables x and y may represent 
the times at which the players I and II take certain specific actions; and 
it is profitable for each player to delay action as long as possible , 
provided his action is prior to his opponent’s action . If the times x, y 
at which players I, II take action are near each other, there is a decided 
difference in the outcome according as x < y or x ]> y. Each player is 
thus subject to the following motive: he wishes to delay action so as to 
Increase his reward, but at the same time not to delay so long that his 
opponent can with effectiveness precede him . 

To be specific, a game will be called a symmetric game of timing 
if the kernel K(x,y) satisfies the following conditions: 



r A(x,y) 

for 

X < y 

(1 a) 

K(x,y) = 0 

for 

X = y 


L -A(y,x) 

for 

X > y 


where A(x,y) is continuous in x < y. 

(1 b) A(x,y) is a strictly increasing function 

of x and a strictly decreasing function 
of y. 

In what follows, we shall make the following additional hypothesis; 

(1 c) A(x,y) has continuous first derivatives 

in x < y, and the set of points where 
A^(x,y) = 0 or Ay(x,y) = o contains 
no linear Intervals x * constant. 
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p 

< y < Pg “ constant, < x < dig* 

As a consequence of (l b), we can assert that 

A^(x,y) > 0, Ay(x,y) <0 for x < y . 

The condition (i c) makes a mild limitation on the places where either of 
these derivatives is zero. 

We sliall show that, aside from trivial cases, the optimal strate¬ 
gy of a game of timing is unique and consists either of a density f-unction 
from some point a to 1, or consists of a jump at o and a density from 
some point a to i . The optimum strategy will be obtained as the solu¬ 
tion of a certain integral equation with a positive kernel. In a wide 
category of cases, this integral equation is equivalent to a certain linear 
differential equation or system of linear first order differential equa¬ 
tions . 


^ 2. GENERAL CONDITIONS ON AN OPTIMUM STRATEGY 

It is easy to show the following: if A(i,l) ^ 0, a pure 
strategy at 1 is the unique optimum strategy; if A(0,l) > 0, a pure 
strategy at o is the \inlque optimum strategy. We exclude these trivial 
cases and suppose henceforth tliat 

(2.1) A(0,1) < 0, A(1,1) > 0 . 


We shall first suppose tliat there is an optimum strategy 
for the game, and derive necessary conditions satisfied by P(x). 


( 2 . 2 ) 

while 

(2.3) 


V(y) 


= K(x,y)clP(x) > 0 for all y , 


j Q V(y)clF(y) J'o J"o K(x,y)clP(x)clP(y) = 0 


by the skew-symmetry of K(x,y). 


F(x) 

Thus 


^The reader may if desired make the further simplification Aj.(x,y) > o 
Ay(x,y) <0 for x < y. 
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LEMMA. 1 . P(x) cannot tiave a jump at an Interior 
point Xq, 0 < Xg < 1, unless ACx^.x^) = 0. P(x) 
does not have a jun^) at x = 1 . 

PROOF. If P(x) had a jump at such a point x^, 0 < x^ < 1 , 

would have 

V(Xq) = Jq K(x,XQ)dP(x) = 0 
+ 

by virtue of ( 2 . 2 ), (2.3)- Letting y —> x^" In (2.2), 

V(Xo') = Jl K(x,XQ‘)dF(x) > 0 , 


SO that 

K(x,Xq') - K(x,x^) j dP(x) > 0 . 

But K(x,Xq“) - K(x,Xq) = 0 exc^t for x = x^, and we have 

+ A(Xq,Xq) I P(Xq ) - P(Xq‘) I > 0 . 

The first part of the lemma is proved. 

The above argument also shows that the following statement can 
be made at the end-points 0 , 1 : 

(2.4) A(0,0)p(0+) > 0 , A(1,1)(1 - Pd")) < 0 . 

Because of A(l,l) > 0 , the second part of the lemma is proved. 

The quantity V(y) is continuous , except at y = o ^ 
A(o,o)P(o'*') ^ 0 . For, if x^ o, 

V(Xq") - V(Xq) = J I K(x,Xp") - K(x,Xq 

= 1 A(Xq,x^) j P(x/) - P(x„-) j = 0 , 

while 


) clF(x) 



VCO"^) - V(o) = A(0,0)F(0‘^) > 0 . 


we 


It follows from ( 2 . 2 ) and (2.3) that 
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(2.5) V(y) = 0 for all points y In the spectriJin of F(x) 

LEMMA 2. The spectrum of P(x) either Is an 
interval from a to 1, or is the point 0 and an 

Interval from a to 1, where a < 1 . 

PROOF. Denote the closed point set which is the spectriim of F(x) 
by S. If S is not the entire set from 0 to 1, let p < y < q be 
one of the open Intervals composing the corrplement of S- For any point y 
in this interval, 


V(y) J^o A(x,y)dP(x) - _ A(y,x)dF(x) , 

so that, hy hypothesis (lb), V(y) is a strictly decreasing function of 
y in this interval. By virtue of (2.2) and (2.5), the left-hand end-point 
p of the interval must be 0. Otherwise p would belong to S, V(p) = 0, 
and by the continuity of V(y) at p, we would then have V(p + cf) < 0 
for small positive This contradicts (2.2), so that p = 0. The right- 
hand end-point q cannot be 1 . Otherwise, 1 would not belong to S by 
Lemma 1, and 0 would be the only point in S; then (2.2) contradicts 
(2.1). The lemma is proved. 

The hypothesis (l b) makes no assertion concerning the behavior 
of A(x,x), except tlriat for x near 1 we have A(x,x) > 0 by (2.1). 

If there are points x on the main diagonal where A(x,x) = 0, let b 
be the maximum of all such points x. Thus A(b,b) == 0, while for 
b < X < 1 we have A(x,x) > 0. If there are no points x where 
A(x,x) =0, we set b == 0. The Interval b < x < 1 will be called the 
basic Interval , by virtue of the following lemma. 

LEMMA 3 - The spectrum of F(x) lies completely 
in the basic interval h < x < 1. 

PROOF. This lemma makes an assertion only if b > 0. Consider 
a new game in which the pay-off is K(x,y) but in which x, y are limited 
to the Interval t)<x<l,b<y<l. This is again a game of timing, and 
we slmll show later in the paper that a game of timing has a solution. 


^By the spectrum of F(x) is meant the set of points x such that either 
F(x* + cJ) > F(x^) for all positive d*, or F(x - <^(x ) for all 

^positive 
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Assuming this, let the solution to this game be (|>(x), b < x < 1 , with 
<|)( 1 ) = 1 , (|)(b) = 0 . Extend (|)(x) below b by setting (|)(x) = o, for 
X < b. Set 

V(y) - K(x,y)d(|)(x) . 

We have: V(y) > o for b < y < l since (|)(x) is the solution to the 
game in the Interval b < x < i . We have 

V(b') - V(b) = |K(x,b") - K(x,b) j dit)(x) = 0 

Since A(b,b) == 0 . Thus V(b“) = V(b) > o. In the Interval from o to 
b, V(y) is a strictly decreasing function of y, so that we may assert 
that 


V(y) >0 in 0 <y<b. 

Suppose now tliat there were points of the spectrum of P(x) in 
the interval O < x < b. Then we would have 

V(y)clP(y) > 0 . 

But / V(y)dF(y) = K(x,y)d<|)(x)dP(y) = - K(x,y)dl'(x)d(|>(y) = 

- /q V(y)di|)(y) < 0 since V(y) > o. This contradiction establishes 
Lemma 3 • 

Lemma 5 shows that we need only consider the game over the basic 
Interval b < x < l- Henceforth, we consider only the basic Interval, and 
ignore the values before this basic interval. With no loss of generality, 
we can let this basic Interval be the interval from o to l, so that 
we have 

( 2 . 6 ) A(x,x) > 0 for 0 < X < 1 . 

LEMMA k. In a < x < 1 , P(x) has a continuous 
derivative P'(x) = f(x). 

PROOP. Set P(o’^) = cL, 0 < c*. < 1 . Let y be any point in 
a < y < 1 . Then (2.5) gives 

(2.7) 0 = AA(0,y) + A(x,y)dF(x) - J^ A(y,x)dP(x) . 

Suppose first that A(x,y) has continuous second derivatives. Then 
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transform ( 2 . 7 ) "by integration by parts into 

0 -AA(0,y) - dLA(a,y) - A(y,l) + 2P(y)A(y,y) 

" P(x)A2(y,x)dx 

where the subscript 1 , 2 means differentiation with respect to the first 
or second argument respectively. This equation can be solved for P(y), 
since A(y,y) 0 , and shows that P(y) has a continuous derivative in 
a < y < 1 . 

If A(x,y) does not have continuous second derivatives, we can 
proceed directly from ( 2 . 7 ). Rewrite ( 2 . 7 ) in the form 


0 = diA(0,y) + 




lA(x,y) - A(y,y))dF(x) 


/ 


^ {A(y,x) - A(y,y)}dP(x) + A(y,y) l2P(y) - - 1) 


and solve for P(y). The result shows that F(y) has a continuous deriva¬ 
tive with respect to y by virtue of the following remarks: 

If B(x,y) is continuous and has continuous first derivatives, 
if B(y,y) =* 0, and if F(x) is a continuous distribution function, then 


J I B(x,y)dF(x) 


has a continuous derivative with respect to y. For 


X) = 


^ B(x,y+h)clP(x) - B(x,y)dF( 

Jy B(x,yi-h)^- B l^I B(x^yfh) . 

The first Integral approaches By(x,y)dF(x) as h —> o, while the 
second integral can be estimated by 

B(x,y+h)^- B(y+h ^ y i. hl dF(x) | < M|p(y+h) - P(y) j , 

where M is a bound in the first derivatives, and this approaches zero 
as h —■> 0. Thus the derivative exists and 

^ Jy B(x,y)ap(x) = Jy By(x,y)dP(x) . 

This shows that the derivative is continuous. 

The lemma is proved. 
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^ 3 - THE INTEGRAL EQUATION FOR f(x) 


In (2.5), set P'(x) = f(x), where f(x) ^ 0: 

(3.1) 0 = *A(0,y) + A(x,y)X(x)dx - A(y,x)f(x)dx, a < y < 1 . 

Differentiation of (5 • 1 ) gives 

( 3 - 2 ) f (y) =‘*.p(y) + J'l L(x,y)r(x)ax, a<y<i , 


where 

( 3 . 3 ) 
and 

( 3 . 4 ) 


P(y) - - 


L(x,y) - 4 


^2^0,y) 

2A(y,y) 

A2(x,y) 

2A(y,y) 

A., (y,x) 
2A(y,y) 


oL> 0 , 


for X < y 


for X > y 


as the fundamental Integral equation wtilch f(y) satisfies. 

The kernel L(x,y) and the function dpCy) are everywhere > o 
by virtue of hypothesis (l b) and equation (2.6). Also, in case 
A(o,o) = 0 , we see from ( 5 «l) that a > 0 ; otherwise, b;y letting y —■> o 
in (3.1) we would obtain a contradiction. Thus, A(y,y) > o everywhere in 
the closed Interval a < y < 1, and the functions L(x,y), otp(y) are 
uniformly bounded in the interval of integration. 

Equation (3*2) is the funaamental integral equation satisfied by 
f(x). But we must also have 

(5.5) J'a = 1 - bX 

and, setting 

(3.6) W = AA(0,y) + A(x,y)f(x)dx - A(y,x)f(x)dx , a<y<1 , 

which must be constant for a < y < 1 by virtue of (3-2), we must have 


(3.7) 


W = 0 . 
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Conversely, If for some oL and a, 0<<i<l,0<a<l, there 
is found a non-negative function f(x) satisfying ( 3 . 2 ), (3-5), (3*7), 
then 


( 3 . 8 ) 


F(x) = •< 


0 for X = 0 
^ for 0 < X < a , 

<^+ f(|)a| for a < X < 1 


is an optimal strategy. For, from (3*7), it follows by multiplying (3-6) 
by f(y) and integrating from a to 1 that 


0 — <k 




y)f(y)dy 


( 3 . 9 ) 

Then we have, for V(y) defined in ( 2 .?), 

^ 0 for y ~ 0 in case cl 0 


V(y) = < 


positive and monotonic decreasing for 
0 < y < a (for 0<3(<a if c*.«0) 

0 for a < y < 1 


Therefore, V(y) satisfies the inequality 

V(y) > 0 

and this means that F(x) is an optimal strategy. The following theorem 
has been demonstrated; 

THEOREM. There is an optimal strategy F(x) if 
and only if there are numbers <K, a, 0 < < 1» 

0 < a < 1 and a non-negative function f(x), defined 
in a < X < 1, which satisfies the equations (3*2), 

(3*5), (3*7)• Then F(x) is given in (3-8). 

i k. ON INTEGRAL EQUATIONS WITH A POSITIVE KERNEL^ 


Consider the homogeneous Integral equation of the second kind, 


^The theorems obtained in ^ 4 are related to similar questions studied by 



106 


SHIEPMAN 


(4,1) L(x,y)f(y)(iy = 4f{x) , p<x<q, 

or. In operator form 


if(x) = Af{x) 

where <)Cf(x) is the Integral operation on the left-hand side of (4.i). ¥e 
will suppose that the kernel L(x,y) is non-negative , and we are interested 
in non-negative solution f(x) of (4.1), l-e., 

(4.2) f(x) > 0 , ° ^ j ^ " ’ 

(throughout this digression, all Integral signs will be understood between 
the fixed limits p, q). The class of functions satisfying (4.2) will be 
denoted by P,. To be specific, the assumptions on the kernel L(x,y) are 
as follows: 

(4 a) L(x,y) > o , 

the points where L = 0 forming on each line x = constant or line y = 
constant a point set containing no intervals. 


(4 b) 

L(x,y) < M 


(4 c) 

J*|L(x 2 ,y) - L(x, ,y)| dy —> o 

and 


J*|L(x,y 2 ) - L(x,y, )j dx —> 0 

if 


Ixg - X, 1 —> 0 or lyg - y,| 

—•> 0 respectively 


Weaker ass\iir 5 )tlons can be made if desired. It follows from 
{h a), (4 b), (4 c) that if f(y) is in P^, then 

J"L(x,y)f(x)dx and J^L(x,y)f(y)dy 

are continuous functions of y and x respectively, and if f(y) is in 
addition continuous they have a positive minimum - 
We sliall prove the following theorems. 


Perron and by Frobenius for finite matrices and by Jentzsch for Integral 
equations. The maximum property of the eigenvalue was told to me by 
S. Karlin, and is related to unpublished work of Bohnenblust and Karlin. 

See Perron, Math. Ann. 65 ( 1907 ), pp- 248-265; Frobenius, Berl. Ber. (1908), 
pp. 471 - 476 ; Jentzsch, J. Reine Angew. Math. l4i ( 1912 ), pp. 235-244. 
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1. There exists a iinlque f(x) in P^, normal¬ 
ized by /f(x)dx == 1, satisfying (4.1) for some posi¬ 
tive A. 

2. If ju is a positive number such that 

(4.3) J*L(x,y)g(y)dy > Mg(x) , a<x<b 

for some g(x) in then A and /i == A only 

if g(x) is a multiple of f(x). (Maximum property of 
the eigenvalue A•) 

3. The inhomogenous equation 

(4.4) (|)(x) = h(x) + fJ^L(x,y)(l)(y)dy 

where h(x) is a given function in P. and > 0 

tias a solution (|)(x) in P^ if and only if ^ • 

The solution is then unique and is given by (4.5) 

(Kx) = h(x) + ^t;=i b(x), where means the 

iterate of X- 

4. If y Is absolutely integrable, and 

Y(x) < h(x) + pJ'L(x,y)Y(y)ciy , where P j > 
then 

Y(x) < (|>(x) 

everywhere. 

PROOF. (1) and (2). Consider the set -A. of a».*s satisfying 

(4.5) for some g(x) in P.j . Setting g(x) = 1, shows that there are 

positive /Ji's in XI, namely Min / L(x,y)dy. Also, integrating (4.5) 

X 

with respect to x and using condition (b) shows that 

/A < M . 

Normalizing the functions g(x) in (4.5) by supposing / g(x)dx « 1, we 
see that 
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g(x) < “ for every x . 

Let A =* Sup M> There is a sequence >u. —> A with g 4 (x), normalized, 
satisfying 

{h.6) ofgi(x) > ^^g^(x) . 

But then also, 

(4.7) JC(«afg^(x)) > ^j^^gj^(x)) . 

The functions «3Cg^(x) are positive continuous functions, and are 

equicontinuous. For, 

|J*L(x^ ,y)g^(y)dy - J L(x2,y)g^(y)dy| < 

^ J"|l(x, ,y) - L(x2,y)j dy 

and equlcontinuity follows from hypothesis (4 c) concerning the kernel 
L(x,y). The theorem of Arzela shows that a subsequence can be found such 
that <iiCg^(x) converge uniformly to a continuous non-negative f (x) . From 
(4.7) we find 

(l^.8) JCf(x) > Af(x) , 

while integrating (4.6) shows that /f(x)dx > A, so that f(x) is not 
Identically 0. Thus A belongs to the set SI. But in fact, equality 
holds in (4.8). For, both sides of (4.8) are continuous functions, and a 
strict inequality at any point x would show that 

i(Xt(x) - Af(x)) > .5 > 0 

for some positive But then 

^(^f(x)) > Arf(x) + ^ > (A + |).rf(x) 

where N = Max ^f(x). This shows that A + ^ belongs to the set Jl, 
contrary to the definition of A- Therefore 

(4.9) if(x)=Af(x) 


and Theorems (1) and (2) have been established, except for the uniqueness 
of f(x). 
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The equality (4.9) shows tiiat f(x) has a positive mlnlmuin. The 
above establishes the existence of a solution g(y) in to the 

transposed equation 

j L(x,y)g(x)dx = A*g(y) • 

The function g(y) Is also continuous and has a positive mlnlmunj. 
Multiplying this equation by f(y) and integrating with respect to y 
yields 


Aj^f(x)g(x)ax =■ A’ J*f(y)g(s)dy 


or A = A' since /f(x)g(x)dx > 0. This shows that there cannot be a 
solution in of (4.1) for any other value of A. Suppose now that 
there is another solution h(x) of (4.9) in P^ . Let 




SO that h(x) - cf(x) > o and = o in at least one point. But since 
;f(h(x) - cf(x)) = A(h(x) - cf(x)) 


it follows that h(x) - cf(x) has a positive rainimuin (unless it is 
identically zero) . This shows ttiat, indeed, 

h(x) = cf(x) , 


and the uniqueness in (1) is established. 

REMARK. The proof we have given uepended on Arzela's theorem. 
Other proofs and other methods can be given depending on notions of weak 
convergence and applicable to different classes of kernels L(x,y). 

(3). Let (4.4) have a solution in P^ . Let g(x) be the posi¬ 
tive eigenfunction for the transposed homogeneous equation (with the same 
eigenvalue A). Multiplying by g(x) and integrating gives 


or 


j i|)(x)g(x)dx = j h(x)g(x)dx + /’AJ^(|)(x)g(x)dx 


(1 


Pa) j (|)(x)g(x)dx = j h(x)g(x)dx 


The integrals appearing are both positive and tfiis requires that 
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1 - f>A > 0 or P < X . 

For P < j , let Sj^(x) be the first n+l terms of the right- 
hand side of (^•5), 

SrCx) = h(x) +Sv«i • 

Multiplying by g(x) and Integrating gives 

J'Sj^(x)g(x)dx = J h(x)g(x)dx . ( 1 + lSv=1 ) 

or 

11m Sj^(x)g(x)dx = . J h(x)g(x)dx . 

The sequence S^(x) Is an Increasing sequence of (positive) functions 
which converges to a function <Kx) (with +« admitted as a value). 

Since g(x) > 0 it follows from a standard theorem ttiat (|)(x)g(x) is 
Integrable (so that » is taken as value at most on a set of measure zero) 
and 

J(p(x)g(x)dx -- Jh(x)g(x)dx . 

But, since g(x) has a positive minimum, (|)(x) Is also integrable. 
Concerning S^(x) we know that 

Sj^(x) = h(x) +/®iSj^_^(x) . 

A passage to the limit yields 

(l)(x) = h(x) + r£^{x) , 


and Indeed a solution Is obtained to (4.4). 

Let y(x) be any solution to (4.4), so that 

Y(x) - (|)(x) == pJh(x,j)(Y(j) - (|)(y))dy . 

Therefore 

|Y(x) - (|)(x)| < pfL(x,y) |r(y) - (|)(y) I dy . 

Since ^ > A, 

Y(x) = (|)(x). 


we see that |Y(x) - (|)(x)| 


must be a null function, or 
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(k). Successive Iteration of the Inequality gives 
V< h + rih + ... + 


so that 


v< If + 


Now 


< pV'IYI 

and this approaches zero almost everywhere, by the argument In the proof of 
5 above (convergence of the series (4.5)). Thus, Y< (j) almost every¬ 
where. But the Inequality then gives 

r< h + Pid) = $ 

so that y< $ everywhere. This completes the proof of the entire theorem. 

^ 5. THE EEPENDENCE ON LIMITS OP INTEGRATION 

Suppose that L(x,y) Is defined over some rectangle, say 
0 <x<l, 0 <y<l, and satisfies conditions (4a), (4b), (4 c) there, 
and th^iat p(yy Is defined in o < y < 1 and is continuous and of class 


. Consider the Integral equations in , 


( 5.1 ) 

n 

L(x,y)fg^(x)dx = A(a)f^(y) , 

a < y < 1 , 

and 




(5-2) 


= P(y) + J*a L(x,y)(t)g^(x)dx , 

a < y < 1 , 

where 

value 

0 < a < 1 . 
A(a), the 

We shall discuss the dependence of the positive eigen- 
non-negative normalized eigenfunction fa^(x). 


and the solution d>a^(x) of the Inhomogeneous integral equation on the 
parameter a. A similar consideration applies if the upper limit is varied 
instead of the lower limit. 

THEOREM 5 . 1 . The eigenvalue A(a) is a strictly 
decreasing continuous function of a with A(a) —•> 0 
as a —> 1 . 


PROOF. For a' < a, define 
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Then 


h(x) 


{ 


fa(x) , 


a' < X < a 
a < X < 1 




L(x,y)h(x)dx 


/ 


L(x,i?)''g^(x)dx = 


non-negative , 
A(a)r^(y) , 


and 

L(x,y)li(x)ux > A(a)h{y) , 

so that 


a' < y < a 

a 1 y < 1 


A(a') > A(a) . 

Flirthermore, equality can hoxd only If h(y) is an eigenfunction for the 
interval a' ^ y ^ 1 • But h(^) =0 on a subiriterval, and an oif.enfuncitlon 
has a positive minimum. Therefore, 

A(a') > A(a) . 

Over the smaller Interval a < x < 1, use the function 

We have 

L(x,y)rg^,(x)cjx = A(a’)fa.(y) - J^a' 

> X(a')fa.(y) - (a - a') 

^ - 5r- A T a~T i'a'(y) 

where m = min i" ,(y) > 0, and we nave used 

y 

<7^ • 


Therefore 


A(a) > A(a') - (a - a') . 

and this establishes the continuity of A(a). 

By integrating (5-1) with respect to y, we obtain 
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A(a) < Max L(x,y)ay < M( 1 - a) . 

Hence A(a) —•> o as a —> 1. This completes the desired proof. 

THEOREM 5-2. The eigerd'unction f^Cx), ^ ^ ^ ^ ^ 
converges uniformly^ to fg^,(x), 9-* ^ x < l , if 
a —> a' . 


PROOF. Prom (. 1) we find 

(5-5) 1 for all y In a<y<1 . 

Also, 

A(a) lfa(yi) - 1 J ^ - L(x,yg) 1 dx . 

Thus as long as a is bounded away from 1, the functions fg^Cy) are 
equicontinuous, and as a —■> a* a subsequence can be found which con¬ 
verges uniformly to a function which must coincide with fQ^t(y) since 
equation (5.1) for a' is satisfied by the limit function. Since this is 
true for every Infinite set of a*s —> a*, the theorem is proved. 


THEOREM 5.3- The function <1 )q^(x) , a < x < 1, 
converges uniformly^ to $at(x) as a —^ a* if 
A(a') <1. If A(a^) = l, then 



(|)^(x)dx —> oo 


and 


/X(x)dx 


converges uniformly^ to f(x). 

PROOF. Let Sq^(x) be the eigenfunction solving the transposed 
equation to (5 • 1) • Then, 

fL t>a(y^8a(y)<iy = , .\(ij Ja p(y)8a(y)dy • 

If a lies in the range a^ + <f<a<1 - cT for some positive , then 
by the uniform convergence of as a varies there is a positive 

lower bound m of g*,(y), and the same upper bound as f„(x) in the 

Qf “ 


^The sense is clear; for example, by transforming the differing Intervals 
of definition of the functions into a common interval by linear trans¬ 
formations . 
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proof of Theorem 5•2: 

0 < m < Sa(y) • 


Therefore 

(5-'^) /lP(y5dy< Jl <|>^(y)dy < „A(a) 0-ACar T /i ' 

Eqxiatlon (5-2) gives 


( 5 . 5 ) 


(y) < p<y> ^ mA(a)?^A(ij) - fl p^y^'^y < 


M, 


and therefore 

ifa^yi^ - i’a^y2^i < ip^ya^ - p(yi>' + “i /i - L(x.y,)i dx. 

Tills proves the equicontlnuit^ of proof of 

Theorem 5.2 the uniform convergence of ^^Cy) to $ 0 ^,( 7 ) as a —> a*. 

If a —> a^, where A(a, ) = 1 , the unboundedness of /a'l>a(’'5dx 
is stated In (5•*^)• Also, 


Slid 


$_(y) ^ P(y) 

-T-^ -< - + M < Mg 


lyya) - yyi^i < ip(y2^ - p^yi^i + m f’ 


ILCx.yg) - L(x,y,)I dx . 


Again this establishes the uniform convergence of 


to the solution f*, (x) of the homogeneous equation. 

It also follows from Theorem 4 of ^ 4 that <Pg^(y) > if 

a < a' . 


THEOREM 5.4.^ 


For a^ < a < l, 


there is a non- 


^By virtue of a supplementary remark at the end of the paper, this theorem 
is not necessary for the application to games of timing. 
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negative function , a ^ x ^ 1 such that 

f- I - I dx —> 0 as h —> 0 , 

£L £L 


where a Is the maxlmijm of a, a+h. This function 
■^^(x) satisfies the integral equation 

Vg^(y) = L(a,y) + J'l l.(x,y)Ya(x)dx , 1 ^ 1 ’ 


H J*^a^ L(x,y)dx —> L(a,y) as h ~> o for each y ^ a 
then ^ exists and 

“ " OiT ^ • 


PROOF. Subtraction of the equations satisfied by 't>a(y)j 

‘•'a+h^y^ 8^^®® 


(y) - <l>a(y) f, 


h (pg^la) 


/' LU.y) (- 




THIjgTal 


. i; L(,„) ^ 


'=’(x)dx 


where a = min (a,a+h). Define Yg^Cy) as the non-negative solution of 
(5.6), and set 


Wy> - w (y) = Y(y) 

h <iig(a) ' 


, f* , 

(5-8) E 


,y) -/ 


^ L(x,y)v^(x)dx - >J(y) 


We have 


■X(y) = 7(y) + J*! L(x,y)X(x)dx 
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(5.9) 


l%(y)l < l>?(y)l + J'^LCx.y) 


IX(x)| dx . 


Theorem 4 of i ^ aiid (5 • **^) gives 


(5.10) 

But 


nt(y) I dy < n,xra T fe(s rr f'- 


p. / ^/®'^^(|)^(x)dx V p. 

J_ n(y)ldy<( - -l) J_L(a,y)dy 


/ii: 


L(x,y)lf^(x)dxdy . 


By virtue of hypothesis (h c), the uniform convergence of $a^(x), as in 
Theorem 5*5, and the hound (5-5) for yg^(x), it follows from this estimate 
that 

fl |il(y) I dy and therefore P l'X(y) I dy —0 as h —> 0 , 

Jr J a 

and this proves the main portion oi tiie theorem. If 

^ J^^a^ L(x,y)dx —> L(a,y) for each y > a , 
this means that >^( 3 /) —0 for each y > a, and therefore from 

iy(y)l < l>|(y)l * “ IX(x)l dx 


we see that X(y) — 0 . 

We can also assert tliat 


q.e.Q. 


h 


remains uniformly bounded as h —> o. For, the uniform boundedness of 
V^(x) Is obtained as In ( 5 - 5 ), of );(y) from Its definition In ( 5 - 8 ), of 
TKy) from (5-9) and ( 5 - 10 ), and finally of the desired quantity from (5-7) • 
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i 6- THE OPTIMAL STRATEGY 

The theory of 4, 5 will now be applied to the particular 
integral equation ( 3 . 2 ) with kernel L(x,y) given by (3-4). The condi¬ 
tions (4a), (4b), (4c) are easily verified. The parameter a is to 
vary over the range 0 < a < 1, except that if A(0,0) == 0 the case 

a = 0 is to be excluded. As in 4, 5 denote the positive eigenvalue of 

the homogeneous equation by A(a'), and the positive eigenfunction by 
fg^(x), a < X < 1 . 

The Integral equation ( 3 . 2 ) has a non-negative solution for 
= 0 only when A(a) = 1, and for dt > 0 only when A(a) < 1. There 

are two cases: either there is a value a^ such that A(a^) = l, or 

A(a) < 1 for all a. 

Case I. A(a^) = l « ‘When a = a^ and = 0 , the function 

f (x) satisfies the integral equation ( 3 - 2 ) and the condition (3-5)* The 
a] 

corresponding quantity W defined in ( 3 * 6 ) vanishes, since this is obtained 
by multiplying (3-6) by fg^ (y) and integrating from a^ to 1 , the 

double integral on the right-hand side vanishing by the skew-symmetry of 
the kernel. The theorem of f 3 shows that we have an optimum strategy. 

That this is a unique optimum strategy follows from the discussion in 
Case II below. 

Case II. A(a) < 1 for all a . We consider here also Case I, 
but then limit the range of a to a^ < a < 1 . For the positive solution 
of ( 3 - 2 ), set 


f(x) =<^(l)g^(x) 


where $q^(x) satisfies 

( 6 . 1 ) (t»j^(y) = p(y) + L(x,y)(|)g^(x)dx , 

The condition (3-5) becomes 

( 6 . 2 ) 


Jl 


a < y < 1 . 


which gives a unique determination oL(a), 0 < c*.(a) < i, in terms of a. 
Denote the quantity defined in ( 3 - 6 ) by W(a), and set 

St} = 


where 
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( 6 . 3 ) U(a) - A( 0 ,y) + J a A(x,y)(t)g^(x)dx - A(y,x)(|)Q^(x)dx , 

a < y < 1 , 

the value being independent of y when y varies in the indicated range. 
The parameter a must be determined by the remaining condition (3«7)' 

LEMMA. U(a) is a strictly decreasing, continuous 
fmction of a with the following properties: 

11m U(a) - A( 0 , 1 ) < 0 
a —»1 



U(a) < 0 in case A(a^) = 1 


U(0) 


A(o_>_oJ _ > 0 

1 + /q 


in case A(a) < l for all a 
and A(o,o) > o . 


PROOF. The continuity of U(a) is a consequence of Theorem 5*3- 
The first limiting relation is clear. To obtain the second and third 
relations, use two equivalent forms of (6.5)* First multiply ( 6 . 3 ) by 
4)g^(y) and Integrate with respect to y from a to l : 

(6.4) U(a) J*^ A(o,y)(|)g^(y)dy 

the double integral terms vanishing because of the skew-symmetry of the 
kernel. Also, set y = a in ( 6 . 5 ). 

( 6 . 5 ) U(a) = A(o,a) - A(a,x)(ti^(x)dx . 

Divide (6.4) by let a —a| , in case /(a,) = 1» 

and use theorem (3.3)- There results 

lUn U(a) = I’ A(0,y)f (y)dy . 
a-»a| J ^ 



A(0,y)f^^ (y)dy < 


A(a^ ,y)fg^^ (y)dy , 


But 
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and this second Integral is zero since it is the negative of the corre¬ 
sponding quantity W in Case I, which was proved to be zero in Case I. 

This proves the second limiting relation. 

To obtain the third relation set a = o in (6.4) and ( 6 . 5 ). The 
two Integrals on the right-hand sides are then identical, and their elimina¬ 
tion gives 


U(0) . -. 

1 + Iq <|)o(x)dx 

There remains to establish the strictly decreasing character of 
U(a)We have by differentiation of ( 6 . 3 ): 

r„ 

( 6 . 6 ) U'(a) = -A(a,y)(|>g^{a) +J ' A(x,y) — 5 ^—dx 

- Jy A(y,x) . ' a ^ y < 1 , 

which Is Independent of y In the Indicated range. Again, obtain two 
expressions for U'(a), first by multiplying by 

~“§a 

and Integrating from a to 1, and second by setting y = a: 


J a aa " 

(fg^Ca) Jg A(a,y) 

3(Da(y) ^ 
aa 




U'(a) = -A(a,a)(|)g^(a) - 

J>(a,x) 

dx . 


The two Integrals on the rlght—hano sides are Identical, and their ellmlna~ 
tlon gives 


U'(a) 


-A(a,a) (|)^(a) 




/ 


da 


dy 


< 0 , 


^This is used below to establish the uniqueness of an optimal strategy, but 
a simpler proof is obtained in accordance with the supplementary remark at 
the end of the paper. The decreasing character of U(a) is then additional 
information about U(a). 
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3$ (y) 

since —I-< 0 as in Theorem 5-^- 

0 a *“ 

lemma. 


This completes the proof of the 


This basic lemma allows us to complete our discussion. In 
Case I, the lemma shows that U(a) < o for all a In the range 
a, < a < 1, and establishes the uniqueness of the optimal strategy 
obtained in Case I. 

In Case II, under the supposition A(o,o) > 0, we see from the 
lemma that there is a unique value of a which causes U(a) to vanish. 
This gives an optimal strategy and also establishes its uniqueness. 

There remains the case when A(0,0) = o, which is not yet 
covered by the lemma because of the unboundedness of the kernel. The 
following lemma completes the theory. 


LEMMA. If A(0,0) = 0, there is a positive 
with X(a^) = 1 . 

PROOF. Suppose that the lemma were false, so that A(a) < 1 for 
all a in 0 < a < 1. Formula (6.4) shows that U(a) < o since 
A(0,y) < 0 for all y > 0 because of A(o,o) == o. There is therefore no 
solution of the game with a > 0. But we have already established in a 
discussion near the beginning of i 3, that a cannot be o in the case 
A(0,0) «= 0. There would therefore be no optimal strategy and if we suppose 
that in this case an optimal strategy must exist, the resulting coritra- 

Q 

diction would establish the lemma. 

We now give another proof of the lemma Independent of the general 
theory of games. Again suppose that the lemma were false, so that 
A(a) < 1 for all a in O < a < l . Take a positive £, and consider the 
game with the same kernel K(x,y) but with x,y limited to the range 
t<x< 1, £<y< 1- For this range the whole preceding theory is valid 
since A(g.,e) > 0. Also, the kernel in the new integral equation corre¬ 
sponding to (3.2J is the same, so that the eigenvalues are the same, but 
the term p(y) in (3.2) and (3.5) is now given by 


p(y) = 


-A2(e,y) 

2A(y,y) 


®It is possible to show from very general considerations in the theory of 
games Uiat in the present case, with A(0,o) = o, an optimal strategy 
exists. In these general considerations, difficulties occur at the end 
points 0,1. Here, no difficulties occur at 0 because of A(0,0) = 0 
(continuity at 0), nor at 1 by the argument in Lemma l . 
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That is, all previous equations remain valid with 0 in the argument always 
replaced by the new lower limit t- 

Let the solution of the game, corresponding to f(x) in (3*2) be 
Yg.(x), with the values a^, of a and d. We have 

f I V {x)dx = 1 - Ot, 

J \ t t 


and since the corresponding W and U are zero, we have corresponding 
to (6.k) 

(6.7) A(£,y)V^(y)dy = o 


and 

( 6 . 8 ) 


ci^A(£,l) 



A(x,1 )V^(x)dx = 0 


corresponding to (6.3) with y = 1- From ( 6 . 7 ), since A(o,y) < 0 for 
y > 0 , we see that —■]> 0 as t —■> 0 . Select a fixed b > 0 so that 
A(b,l) < 0. We have, from ( 6 . 7 ) for sufficiently small £, 



e.y)yg (y)dy + 



A(€,y)yj(y)dy = 0 


or 


(A(£.y) - A(£,a^))V^(y)dy + (A(£,y) - A(£,b) )Y^ (y)dy 


= -A(€,a^) \ - A(t,b) 


Vg(y)<iy 


The left-hand side la < 0 , while the right-hand side approaches 
-A(0,b) 11m V(y)dy which Is > 0 - unless the limit expression la 
zero. Therefore llm V,(y)dy = 0 . 

From (6.8), we now have 


di^A(6,1) + tA(x,l) - A(b,l))yg(x)dx + A(b,l) (l - yg_(x)dx^ 

+ J^ {A(x,l) - A(l,1))Vj^(x)dx + A(1,1) Vjx)dx = 0 . 


Take the limit as g. —> o. All the Integrals above except for the last 
are < 0 . with Y^(x)dx —> 0 , and A(o.i) < 0 , A(b,l) < 0. If 
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^ ® ^ ^ ^that the limit of the left-hand side of the 

above equation is definitely < 0, contrary to the equation. This is a 
contradiction and the lemma is established. 

This completes the proof of the main theorem. 

^ 7. REDaCTION TO LINEAR DIPFTKENTIAL EQUATIONS 

In a wide category of cases, the integral equation (3-2) is 
equivalent to a system of ordinary linear differential equations. This 
occurs if the function A(x,y) has the following special form: 

A(x,y) = Pi(x)qi(y) • 

Set 

J*y p^(x)f(x)dx = ^^(y) , J’y qj^(x)f(x)dx = l^^Cy) 
or 

i](y) = -Pj(y)f(y) > Ijd) - o, j = i, .... n 

(7.1) -i 

l^.(y) = -qj(y)f(y) , ijj.d) = o, j = i, n . 

The integral equation becomes 

(7.2) 2A(y,y)f(y) = Pi(o)qi(y) - qi(y)(|i(a) - ^J^(y)) 

+ Pi(y) li(y) • 

Temporarily set oLp^(O) + = c^, where c^^ are arbitrary coeffi¬ 

cients. Substitution of (7-2) into (7«l) gives a system of ordinary linear 
differential equations for depending linearly and homo¬ 

geneously on the parameters c^. The solutions of this system also depend 
linearly and homogeneously on c^. The equation 

gives a system of n linear equations for the determination of c^ in 
terms of a,<i and the conditions (3-5)^ (3-7) then determine cal,a. The 
question of the unique solvability for the parameters is answered by our 
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main theorem, provided the monotonxclty conditions of the theorem are 
satisfied. 


SUPPIiEMENTARY REMARK 

The proof of the uniqueness of an optimal strategy can he given 
In a simpler form than presented In the body of the text. The existence of 
a solution Is a consequence of the lemma In #6, the uniqueness following 
from the decreasing character of U(a). Instead of the decreasing character 
of U(a), one can also use the following lemma: If there are two optimal 
strategies , they must have the same spectrum . This Is proved as In the 
proof of Lemma 3- 


M. Shlffman 


The RAND Corporation and 
Stanford University 




REOTCTION OF CERTAIN CLASSES OP GAMES TO INTEGRAL EQUATIONS’ 

Samuel Karlin 

In this paper the solution of certain classes of games is reduced 
to the problem of solving associated integral equations. The games treated 
share the important property of a diagonal discontinuity in the payoff 
kernel or Its derivatives and it is precisely this that leads to the inte¬ 
gral equations. In all but the final class considered the optimal strate¬ 
gies are unique. 

Part I deals with the general game of timing which was analyzed 
in the symmetric case by M. Shiffman [ 2 ]. In these games the diagonal 
discontinuity of Lhe payoff (1 .1) manifests the dependence of the result of 
a play on the oraer in which the players act; the optimal strategies are 
distributions which are (mainly) density functions, thus reflecting the 
lack of perfect Information in these games. In the final portion of Part I 
the analagous game of perfect information is considered as a limiting case. 

Part II examines payoff kernels which are concave on each side of 
the diagonal and which the discontinuity appears in the derivatives of the 
payoff. The optimal strategies obtained here are similar to those obtained 
in Part I. Several examples are given to illustrate the general theory. 

PRELIMINARIES AND NOTATION 

We introduce some standard notation which will be used throughout 
this paper. The payoff kernel L(x,y) shall be defined on the unit square. 
The following strategy (= distribution) P = (oCIq, 4>ab(x), ) shall mean 

that P has a jump of value (*. at zero and a jump of value ^ at one 
while 4>ai3(x) represents a continuous density function over the Interval 
[a,b]. Precisely, P(x) = oC + /q for 0 < x < 1 and 

p(l) = oC + (|)^^ + /S = 1 . Whenever the notation is used then it is 

to be understood as . Pinally [a,b] is taken to be the smallest 
Interval outside of which is identically zero. The spectrum of P 

shall Include all points x for which every neighborhood of x has posl- 


^The preparation of this paper was sponsored (in part) by the Office of 
Naval Research and (in part) by the RAND Corporation. 
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tlve P measure. The point spectrum of P shall consist of those points 
at which P possesses a jump. The jump of P at a point shall be 

denoted by < 7 ^ P. The definition of spectrxam Inplles that the spectrum Is 
^o 

closed. Similar notation shall be used for quantities associated with the 
G strategy. 


PART I 

The kernel investigated In this section Is of the following form: 

r K(x,y) X < y 

(1.1) L(x,y) = i(x) X - y 

L M(x,y) X > y 

satisfying the following conditions: 

(a) The functions K(x,y) and M(x,y) are defined on x == y 
and have continuous second partial derivatives defined in the closed 
triangles x < y and x > y respectively. 

(b) The value 5( l) lies between K( 1, 1 ) and M( l, l) and 
1(0) lies between K(o,o) and M(o,o) while the value assigned to Kx) 
for 0 < X < 1 Is bounded but otherwise arbitrary. 

(c) The most inportant requirement Is that 

K^(x,y) > 0 and M^(x,y) > 0 for x < 1 
Ky(x,y) < 0 and My(x,y) < 0 for y < 1 

(in their respective domains of oefinltion). 

In particular, K ana M, in their respective regions of defini¬ 
tion, are strictly increasing in x and strictly decreasing in y. 

A solution to the game defined by the payoff kernel L(x,y) Is a 
pair of distribution functions P(x) and G(y) where 0 < x < 1 and 
0 ^ y < 1 together with a real niimber v such that 

L(x,y)dP(x) > V for all y and 

JQ L(x,y)dG(y) < v for all x. 

If P(x) is a strategy of the form (<^Iq, ^explicit 

expression for L(x,y)dP(x) reads, for 0 < y < 1, 
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JoL(x,y)dP(x) =<iK(o,y) + J*yK(x,y) (t)^^(x)dx + J'^(x,y) $^^|(x)dx +y8M(l,y). 

It Is of course tinderstood that for y < b the integral K(x,y) 1»g^^j(x)dx 
does not appear with a similar remark applicable to the Integral 
/y M(x,y) il)g^^(x)dx for y > b. For y = 0, o(K(o,o) must be replaced by 
c«.S(0), and for y = i, /5M( 1,1) by 

The procedure we follow will be to try to find a solution of the 
following form: an absolutely continuous distribution with continuous 
derivative on the interior of the unit Interval with additional possible 
jumps at the ends of the interval. Such solutions will be exhibited and 
afterwards their uniqueness will be established. The following lemma serves 
only as a guide to the subsequent theory. It will not be explicitly used 
hereafter. 


LEMMA 1.1. If both players possess optimal strat¬ 
egies of the form F = ^^1^ 

G = then the form of the density 

is given by and y^d "" *^1 

trum of the absolutely continuous part of both distri¬ 
butions begin at a common value 0 < a < 1 and extend 
to the upper end of the unit interval. 

PROOF. For any distribution of the type Indicated above, we see 
that /q L(x,y)dF(x) is continuous and non-increasing for 0 < y < 1. If 
(|)(x) is zero in any interval, then / L(x,y)dF(x) is strictly decreasing 
in that portion by condition (c). Since F(x) represents an optimal 
strategy and c is in the spectrum of G, it therefore follows that the 
yield / L(x,y)ciF(x) = v for c < y < 1, and hence that the spectrum of F 
includes the interval [c,l]. A similar argument applies to G and we 
establish that c = a. 

THE MAIN THEOREM 

The main theorem of Part I deals with a conplete description of 
the optimal strategies for the payoff kernel (1 .l). Unfortunately, many 
different type of solutions may occur depending upon the nature of K(x,x), 
M(x,x) and the values of L(x,y) at the extreme points of the unit sqmre. 
It is therefore necessary to present a mutually exclusive classification of 
the various possibilities. The analysis of the kernel L(x,y) of (1.1) 
subdivides into three main parts. In the case where there exists an x^ 
such that K(Xq,Xq) = M(Xq,Xq), then the type of optimal strategies that 
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appear occur under the headings of B, C and D of Theorem 1 . More precisely, 
the essential feature Is to study the spectral radius A(a) and ^(a) of 
the two Integral equations (1.2) and (1-3) given below. The type of solu¬ 
tions as described In B, C, and D always appear when either A(a) >1 or 
Mb.) > 1 for some a In the unit Interval. Furthermore, If 
K(Xo,Xq) = M(Xg,x^) for some x^ with o < x^ < 1 , then It follows that 
both A(a) > 1 and ju(a) > 1 for some a In the unit Interval. The 
second and third parts of Theorem 1 suppose that both K(x,x) > M(x,x) for 
0 < X < 1 and A(o) < 1 and /i( 0 ) < i . Tlioy aiv distinguished by the 
assumption of K( 0 ,i) < M(1,o) and K(o,i) > M( i ,0) respectively. In 
both cases the value 5 (o) plays a very fundamental role. 

The statement of the theorem to be established in Part I Is 
summarized in the following array: 

THEOREM 1.1. The optimal strategies for the pay¬ 
off kernel (1.1) are unique and are enumerated in the 
following table: 



Kernel 

Optimal P 

Optimal G 

A 

K(1,1 ) < M(1 ,1) 


h 

B 

K(x,x) > M(x,x), a < X < 1 

A(a) “ 1 >u.(a) < 1 

(1>a) 

(Y^, cfli ) 

C 

K(x,x) > M(x,x), a < X < 1 

A(a) = 1 /*(a) = 1 

(V 

(Va) 


K(x,x) > M(x,x), a < X < 1 

(V Ph'> 

(V 

D 

Mb) < 1 An(a) = 1 




If K(Xq,Xq) = M(Xq,Xq) 
for some ° ^ *0 ^ ' 

B, C, or D 

B, C, or D 

K(x,x) > M(x,x), 0 < X < 1 

A(0) < 1 >u(0) < 1 

K(0,1) < M(1,0) 

E 

§(o) = K(0,o) 


(V 
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Kernel 

Optimal P 

Optimal G 

p 

< Ko) < K(0,0) 


(rg. V <fi,) 

G 

$(o) = Sq 



H 

M(0,0) < 1 0) < Sq 

Kg. 0a> 


I 

M(o,o) = i(o) 

(00' 

(Jg, g) 


K(x,x) > M(x,x)j 0 < X < 1 
Mo) < 1 /jl{0) < 1 

K(o,l) > M(i,o) 


J 

K(0,l) > §(0) > M(1,0) 

h 

^0 

K 

K(0,0) > 5(0) > 1L(0,1) 


(yg' g.Ji,) 

L 

K(0,0) = i(o) 

('^lo' g) 

(Yq, rfii) 

M 

M(1,0) > i(0) > M(0,0) 


('g' Ta) 

N 

5(0) = M(0,0) 

(00' 

(arg, Yo) 


Furthermore, the 

densities $ and Y 

a *e obtained as the solu- 


tJon to certain Integral equations. These solutions are either Neumann 
series or eigenfunctions of integral operators. 

The proof of this theorem shall be alvideb into a series of 
lemmas. The aim of the first series of lemmas, Lemma 1.2 - 1.16 is purely 
to show the existenc-; of the solutions indicated in the shorthand of 
Theorem i.i, in the various cases A through N. The uniqueness question 
is settled by Lemmas i.l7 - 1.20. 

LEMMA 1.2. If 1,1) < M( 1,1), then the point 

(1,1) Is a saddle point of the kernel L(x,y). 

PROOF. The statement is an immediate consequence of conditions (b) 


ana (c). 
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THE INTEGRAL EQUATIONS 


On account of Lemma l .2 we can suppose in all that follows that 
K( 1 ,1) > M( 1,1). The continuity of K and M provides a non-empty Inter¬ 
val a < X < 1 for which K(x,x) > M(x,x) . We introduce now the following 
integral equations: 

Let 

(1.2) f(^) - 

where 


T(x,^)f(x)dx = oi.p^(^) + ^P 2 (^) 


T(x,^) = 


r 




-gy(x4) 


-My(x,^) 


Pi (4) 


-Ky( 0 >^) 


= 


a < X 


a < ^ < X < 1, 


and ft. and y3 are constants- 

For convenience, we denote this equation by 
(I - Tg^)f = oCp^ + /Spg# I being the identity operator and Tg^ denoting 
the integral operator defined by the kernel T(x,|) and lower limit a. 
Let 

(1.3) g(>}) - 

where 


U(> 7 ,y)g(y)dy == iTq^ (>;) + 6q^(y^) 


and 




r 


< 






a < y < )^ 


>/< y < 1 


qi(»f) 






Qsirj) = 






Again, we denote this equation by (I - Ug^)g = + ^q 2 ‘ Banach space 

upon which these operators T_, U_ act shall consist of all continuous 
functions defined on the interval a < x < 1 . Whenever a function f in 
the domain of T^^ is considered on an Interval extending beyond a ^ x < 1, 
then it is -co be understood that f is taken to be zero outside of 
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^ ^ ^ ^ ‘ Equations (1.2) and (1.3) are considered over an interval 
[a,l] in which K(x,x) > M(x,x) . Consequently, the operators T^^ and U^^ 
are strictly positive conpletely continuous operators. We enumerate some 
of the properties of such operators. 

I. If A(a) denotes the radius of the smallest circle containing 
the spectrum of T^^, then A(a) is an eigenvalue and has a unique positive 
eigenfunction solution. The strict positivity guarantees the xaniqueness. 

II. The quantity A(a) is a monotone continuous function of a. 

When a —■> l, then A(a) —■> 0. The eigenfunction solution fg^ converges 
uniformly for any preassigned a-o T 1 ^ ^ ^ ^a a.s a tends 

to a^. ° 

III. Finally, if X> A(a), then (I - ^ T„)"’ exists and is 

„ T n ®' 

given by ‘ This series applied to a continuous function con¬ 

verges uniformly on the interval [a,i]. This series representation for 

Tr 1 

the operator (I - -^) defines thus a strictly positive transformation 
which maps continuous positive functions into strictly positive continuous 

'^a 1 

functions. In addition, (I - -^) varies continuously with a in the 
sense described in II provided that A > A(a) + Similar results apply 

to the operator U . There we eitploy the notation of >u.(a) in place of 

A(a) . 

The results enunciated above are deduced elsewhere as special 
applications of a general theory of positive operators developed by P. H. 
Bohnenblust and the author [1]. We shall employ them throughout the re¬ 
mainder of this paper. 

Case B. C, and D . 

LEMMA 1.3* If there exists an x^ with 
0 < Xq < 1 and K(x^,Xq) « M(x^,Xq), then there exists 

an a > Xq such that A(a) = 1 . Similarly, a* > x^ 

exists with /*(a*) - 1 . 

PROOF. We treat only the case involving A(a) = 1 . Let de¬ 

note the largest x for which K(x,x) « M(x,x). Therefore, for < x < 1, 
we have K(x,x) > M(x,x). Furthermore, let fg^(x) with a > x^ denote the 
eigenfunction associated with T^ and A= A(a) . Let e > o be chosen so 
that X < 1 - £. For a such that x^ < a < 1 - E, we may assume f^ 

O' , - u a 

has been normalized so that fg^(x)dx = 1. 

Now by condition (c) there exists a k > o for which 

-Ky(x,y) > k, X < y < 1 - £, 

-My(x,y) > k, y < X ^ 1 - £, 
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so that, 
0 < k 


for Xq < a < Tj < 1 - £ 

< J*2 - Ky(x,>))f^(x)dx + - My(x,>|)f^{x)dx . 


But since = Afg, this last expression is [K(i^,)^) - M(>j,>j)]. 

fa(>l)A(a), so that 


k 

(1.4) o< - 

[K(^j,>j) - Mir/,if) 1 

Since the partial derivatives of K and 
C for which 


-<A(a)fg(>j) . 

M are bounded we have a constant 


K(^,yf) - - [K(>/,>j) - M(7 },>j)1 - [K(x^,Xq) - M(x^,x^)] < C(>^ - x^) . 


Consequently, 0 < ■ < A(a)fg(>^), 

yields ^ 


and integration over (a, 1 - €.) 


Hence A(a) becomes unbounded as a tends to x^, and since A(a) —> 0 
as a —1 , by Property II we have an a for which A (a) = 1 . 


LEMMA 1.4. Under the assumption oi‘ Lemma 1 .5 there 
exist optimal strategies for both players of the form: 
an absolutely continuous distribution oyer an interval 
[a,l] with a possible jump at 1 for one of the 
players. 

PROOF. Lemma 1.3 implies the existence of an a (a > x^) for 
which either A(a) = l and >u.(a) < 1, A(a) = 1 and /^(a) = i , or 
A(a) < 1 and /A.(a) = i . We begin with the first case. Since A(a) = 1, 
we obtain a (pg^(x) > 0 normalized by ^ which Tg(|)g = (|)g. 

This implies that 

(1-5) u(a) = J*! K(x,y)<|)g^(x)dx + Jy M(x,y)(|)g^(x)dx for a^y^l 

where u(a) is a constant depending only on a, since differentiation of 
equation (l . 5 ) yields precisely the relation Tg(|)g = consider 

^^(x) extended beyond the interval [a,l] so that ~ ^ elsewhere, 

then on differentiating the right-tiand side of ( 1 . 5 ) we obtain, in view of 
condition (c), a negative value when 0 ^ y < a. Thus the e^qjresslon 
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L(x,y)<|)g^(x)clx > u(a) for o < y < a by virtue of the continuity of 
this Integral. Moreover, as /u(a) < i, according to Property III we can 
write (I - = fg '*2 > ^a define 

cf = so that J = 1 - cT. Put Y^iy) = dYsW ■ The eqiiatlon 

(I - U„) ~ cfQo becomes on integration 

cl cl d. 

(1.6) w(a,.ft =c/'K(x.l) + J* M(x,y) V^(y)dy + K(x,y) Ya,<‘'y'>’^ 

for a < X < 1 . 

An analysis similar to that applied to equation (1.5) shows that 
L(x,y)da(y) < w(a,d‘) for o < x < a where G(y) = • Integra¬ 

tion of ( 1 . 5 ) with respect to G and (1.6) with respect to F now yields 
u(a) = w(a) = V. This establishes the proof for the case A(a) = 1, 

Ai(a) ^ 1 . A symmetrical argument can be applied to the case A(a) ^ 1 , 

Ma) « 1 . Finally, when A(a) - >u(a) = 1 both the solution and proof are 
simpler. Both players use only absolutely continuous distributions which 
are the eigenfunction solution to “ ^a ^a*^ ” ^a’ details 

of this case are a straightforward adaptation of the arguments already 
given. 

In the future we may assume that K(x,x) > M(x,x) for 0 < x < l . 
The operators T^^ and may be now considered for any a in the unit 

Interval. 

T.-RMMA 1 . 5 . If there exists an a for which either 
A(a) or / 1 (a) = 1 with 0 < a < ^ y then Case B, C, or 
D occur with optimal strategies existing of the form 
indicated in Theorem 1 .1 . 

PROOF. Since A(a) and M(a) tend monotonically to zero as a 
tends to one, by virtue of the hypothesis it is clear that there exists an 
a* with either A(a*) = 1 /^(a') ^ A(a*) = /^(a*) = 1 > or 
A(a*) <C 1 /A.(a') = 1 • The remainder of the proof follows as in Lemma 1.4. 

A(0 ) C 1. m( 0) <1. and K(0.1) < M(1.0) . This section con¬ 

siders the case where A(o)^l /i(o)^l and K(0 ,l) ^ M(1,0 ). These 
conditions also imply that K(x,x) y M(x,x) for 0 ^ x^^ 1, by Lemma 
Since A(0) < 1 and /i(0) <1, we can form (I - Tg^)"'' and (I - Ug^)"’ 
for every a with 0 < a < 1 and, in view of Property III, these operators 
transform positive continuous functions into strictly positive continuous 
functions. Furthermore, as a —> l , then (I - Tg)‘''p * (j)^ —> p and 
hence (pg^ — 0 . An analogous remark applies to (I - Ug^) . If we 
set (I " h l=i>2. then (I - TJ"’(dp, +/Spg) - 

+ M 2 * choose cL and fl non-negative satisfying 
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oL/^ (|)^ + (|)g « 1 - bL - /S, so that P » (oClQ,(|>g^,/9I,) is a strategy. 

Now 

(1.7) u(a;ot,/S) = «tK( 0 ,y) +/tfM(1,y) + JyK(x,y)(lig^(x)dx + J^(x,y)(|)j^(x)dx 

for a< y< 1 (where u(a;ct,/S) Is independent of y), since differen¬ 
tiating this expression with respect to y yields ecp, + /Spg = (I - 

Moreover, in view of condition (c) we have, for* 0 ^ y < a, 

(1.7a) u(a;«*.,^) < <<K( 0 ,y) +/SM(1,y) + M(x,y)(|)g^(x)dx 

so that u(a;(i,/3) < / L(x,y)dP(x) for o < y < i . 

Similarly, if we set (I - Ua)"’qi = 'T^' ^ > 2, and choose 

y, <r > 0, satisfying If /a Ya = ’ " 

+ JYg that 0 = (YlQ,yg^,/l,) 13 a strategy and 

( 1 . 8 ) w(ajK,<i’) = lfM(x,o) +</*K(x.l) + J'* M(x,y)K^(y)dy + 
for O' X < 1 ; and again in view of (c), 

w(a;y,J’) > YM(x,0) +</’K(x,l) + *^(x,y)yg^(y)dy 

for 0 < X < a. Consequently w(a;y,J‘) > / L(x,y)dG(y) for 0 < x < 1 . 

We now have available the five parameters d., fi , 3 r, cT and a 

(subject only to the conditions cL, jBs if» 

-r-j-) 

which, as we shall show in this and the following section, may, in each of 
the remaining cases of Theorem i.1, be chosen to insure the following con¬ 
ditions : 




K(x,y)vC(y)dy 


u(a;<*,/3) = w(a;if,J’) 

/ L(o,y)dG(y) and /L(l,y)dG(y) < w(a;Y,(f) 

/ l,(x,o)dP(x) and / L(x,l )clP(x) > u(a;o(,^) • 


When these conditions are fulfilled we shall evidently have, for all x 
and y. 


J L(x,y)dP(x) > u(a;<Jt,/3) 


V = w(a;y,J’) 



L(x,y)dG{y) 


l.e., that (P,G) is a solution. 
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In the remainder of Part I It is to be xmderstood that in writing 
we tacitly assume that /®>o, 0 <a< l and 
oC/^ (|)^ + yS (pg = 1 - oL - /5. We note specifically that we may always 
take cL (or fi) to be zero, and that then yS = (i + 7 ^ ^ 2 ^ ^ 
tinuous function of a. We may also require oL and p to have a fixed 
ratio r, 0 < r < + 00 , In which case u(a;flL,r )* is a continuous function 
of a. Similar remarks of course apply to y and cf. 

LEMMA 1 . 6 . For any ratio r there exists an a 
for which u(a;o(.,o) = w(a;)r,rar). Similarly there exists 
an a* for which u(a*;ci,rc#-) - w(a';ir, 0 ). 

PROOF. If in (1 .?) and (1 .8) we set x = y = 1 , then for any 
£ > 0 and a sufficiently close to 1 we have 

lu(a;o(,/3) - [*K(0,1) +/3M(i,l) + ( Ja ^ 

|w(a;IS',d’) - [ITMd.o) +<fK(1,l) + ( < ^5 • 

Since /’ ^ and /I 'VT —> 0 as a —> 1, we conclude that for a 
a a a a 

near 1 

|u(a;<t,/3) - w(a}ir,d’) - ('1K(0,1) +/3M(1,1) -mi,0) -JK(1,1))I <£ . 

for any appropriate values of d, /i, Jf> tf- Now by assumption 
K(0,1) < M( 1 , 0 ) and < K(1,1) while monotonlclty Implies that 

K(o,l) < K(l,l) and M( 1 , 1 ) < M(l,o). Since 

1 - <1 - /3 = ^ Os 

and 

both tend to zero as a —> 1 , we have clearly 

<*.K(0,1) + y3M(l,l) - yM(l,0) - «fK(1,l) < 0 

for a sufficiently close to 1 , for any appropriate values of et, fi, X. <f. 
Consequently u(a;«c>/S) - w(a;y,<!r) < 0 for a near 1. 


*Here we make the convention that u(a;«'l,<«>-A) — u(a;0,^). 
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X = 1 in 

then let 

Let us now substitute 
(1.8); similarly set 
y —> 1 in (1 .7) ■ We 

the values 

a = 0, then 

obtain the 

a = 0 , X « 0 , and 
let y — >> 0 and 
equations 

(1 -9) 

u(0;o(,/S) = otK(0,0) 

+ ^M(1,0) + 

M(x,0)(|)^(x)dx 

(1 .10) 

w(0;ir,of) = m(0,0) 

+ crK( 0 ,l) + 

K(0,y)y^(y)dy 

(1 .11) 

u(0;o(,/S) •= olK( 0,1 ) 

+ /SM(1,1) + 

Jy K(x,1 )<|)Q(x)dx 

(1.12) 

W(0;y,<f) = l'M(1 ,0) 

+ </K( ,1) + 

J 0 M (1 ,y)r^(y)Qy 


Also, if we multiply (1 .?) by integrate we obtain 

(1 15) (1 - )r - cf)u(0;c».,/3) = K(0,y)f^(y)ay + /5M(1 ,y)fQ(y)dy 

+ J*o Jo • 

Similarly, multiplying (1 .8) by integrating we obtain 

(1.14) (1 - ol -/3)w(0;!r,<n - i" M(x,0)(|)^(x)dx + <r K(x, 1 )(|)Q(x)dx 

+ J*o Jo L(x,y)$y(x)'V^(y)cixdy . 

Multiplying (1.9), (1.10), (1.11), and (1.12) by jf, ck, <f, and 
/3 respec.-.vely and eliminating the integrals yields finally 

(1.15) u(0;0C,/3) - w( 0 ;ir,^) - dX[K( 0 , 0 ) - M( 0 , 0 )] + /3(f[M(l,l) - K( 1 ,1 ) ] . 

Now if either /3 or cf is zero, say we have u(0;c3C,o) - > o 

sinoe K(0,o) > Ml0,0). Since i (a;oL,o) - w(a;y,rir) is a continuous func¬ 
tion of a, the conclusl ri of the lemma is evident. We note for further 
use that ( 1 . 15 ) does not uepend 1 the assumption K(o,l) < M(l,o). 

LEMMA 1.7* Statement E in Theorem 1.1. 

PROOF. If in (1 . 7 ) ana (1.8) we set ^ = }f - 0, then ( 15 ) 
shows that u(0;c(,o) - w(0;0,cr) = V. Consequt.ntly, we have only to show 
/ L(x,0)dP(x), / L(x,l)dF(x) > v and / L(0,y)dG(y), / L(l,y)dG(:,) < v, 

where P = and G = The assuii 5 )tion $(0) = K(o,0), 

inplies / L(x,o)dF(x) = v, and since fi - 0, f L(x,l)dP(x) == v. 

Similarly since = 0 , / L(o,y)dG(y) = v, and 

jL(i,y)dG(y) =J’i(l) + JoM( 1 ,y)y^(y)ay < <yK( 1,1) + JoM( 1 ,y)r^(y)dy - v . 
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In a similar manner one can establish 

LEMMA 1.8. Statement I in Theorem 1.1. 

LEMMA 1 . 9 . There exists a value with 
M(0,0) < Sq < K(0,0) for which 1(0) = implies the 
existence of optimal strategies of the form indicated 
in Case G of Theorem 1.1. 


PROOF. We take ^ = cf = o, and abbreviate u(a;o<.,o), w(a;y,0) 
by u(a), w(a) . Lemma 1 .6 in^Dlies the existence of an a for which 
u(a) = w(a), and (1.15) Implies a > 0. Consequently 
I L(x,y)dG(y) < v * w(a) for o < x < a and / L(x,y)dF(x) > v for 
0 < y < a, where P = , G ^ • Since >8 = cT = 0, we have 


Jl(x,1)(JP(x) = V - jL(1,y)dG(j 




o)dF(x) = (k^{o) + 


M(x,o)(|)g^(x)dx , 


and ( 1 . 7 a) implies 


V < c(K(o,o) + I ^ M(x,0)(|)g^(x)QX . 


If $(o) = M(0,0), since we then have 


V > yM(0,0) + K(0,y)rg^(y)dy = J'l( 0,y)dG(y) , 

and oL> 0, we obtain // L( x,y )dP(x)dG(y) < v, or 

/q L(x,0)dF(x) + L(x,y)QF(x)rg^(y)dy = ^ L(x,0)dF(x) + v(l-a() < v 

or L(x,0)dF(x) < v. Hence for some value S^, M(o,o) < S^ < K(0,0), 
for $(0) we have L(x,0)dF(x) = v. This in turn implies 
L(0,y)dG(y) = v since then 

V - J'Q(jQL(x,y)dF(x))aG(y) = cljQL(o,y)dG(y) + J ^jQL(x,y)dG(y))(|)g^(x)dx 

= clJyL(0.y)dG(y) + (1 - <l)v . 


It is assumed in the next lemma that the value a^ of a used 
in Lemma 1 .9 is the least a for which u(a;oL,o) =* w(a;y,o). Hence for 
0 < a < a^ we have u(a;ct,o) > w(a;y,o). 
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lemma 1.10. statement P in Theorem 1.1. 

PROOF. The function f defined by 

f(a) = j [u(a;oi,o) - M(x,o)(|)g^(x)dx 3 , 

where <*.= (1 + /^ <!>,)"’» is continuous. By (1-9) f(o) = K( 0 , 0 ), and as 
we have seen in Lemna 1.9. fCa^) = S^. Consequently, If 

Sq < Ko) < K(0,0) there exists an a, 0 < a < a^, for which f(a) = S(0), 
or, for F = 


/l(x. 


o)dP(x) = olKo) + 


Ji M(x,o)4.^ 


(x)dx = u(a;oL,0) 


Since >3=0, we also have / L(x,i)dP(x) = u(a;ol, 0 ) . 

In view of the remark preceding this lemma, u(a;oC,o) > w(a;lf, 0 ) 
for this a. However, taking ir = o and G- = ) yields 

u(a;oL, 0 ) = L(x,y)dP(x)^ dG(y) 

= L( 0 ,y)dG(y) + L(x,y)dG(y) (|)g^(x)dx 


= L(o,y)dG(y) 


+ (1 - oL)w(a;0,QO . 


Since 


J*L(0,y)dG(y) =crK(0,l) + K(0,y)^(y)dy < w(a;0,cf) , 

we must have u(a;ot, 0 ) < w(a; 0 ,cr). Clearly then there exists X, cf > 0 
for which u(a;ot,o) = w(a;'ir,cr) = v. 

We shall now verify that F = and G(yiQ,'^,ori^) are 

optimal. We already have 

J^L(x,0)dP(x) = J*L(x,1 )dF(x) = v . 

J'hd ,y)dG(y) =yM(i,o) +€?$(!) + l ^y)fa(y)cly 

< yM(i ,0) + oPKCi ,1) + J*a ,y)^(y)dy = v , 


Now 


and since v = /q(/q L(x,y)dF(x) )dG(y), 


V * ^fo L(o>y)dG(y) + (1 - cC)v 
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so that / L( 0 ,y)dG(y) - v, and the proof is conplete. A similar proof 
yields 

LEMMA 1.11. Statement H of Theorem 1.1. 

A( 0 ) < 1 , >u< 0 ) < 1 , and K( 0 , 1 ) ■ M(1 ,0) ^ 0. It remains only to 
consider the case where K(0,1) - M(1,0) > O. If M(l,o) < $( 0 ) < K( 0 , 1 ), 
then it is easily verified that a saddle-point exists at (0,0) . This 
establishes 

LEMMA 1.12. Statement J of Theorem 1.1. 

LEMMA 1 . 13 * Statement L of Theorem 1.1. 

The proof of this proposition is identical with the argument of 

Lemma 1 . 7 * 

In a similar manner to Lemma 1.8, we liave 

LEMMA 1 . 14 . Statement N of Theorem 1.1. 

LEMMA 1 . 15 * Statement K of Theorem 1.1. 

PROOF. If we set /^ = y = a = 0 in equation (1 .?) we obtain 
u(0;d,0) =o(K(0,0) + M(x,0)(|)^(x)dx; 

consequently the continuous function f defined by 

f(a) - ^ [u(a;<i,0) - 1 A{x, 0 )^^{x)dx] , 

where ot = (l + /I has f(0) = K(0,0). Inserting the values 

cL I 

y 3 = 0 ,y =1 In ( 1 . 7 ) yields 

u(a;d.,0) =oCK(0,1) + K(x, 1 )(|)^(x)dx , 

so that 

f(a) = K(o,l) + s J^a (K{x,i) - M(x,o))it)g^(x)dx . 

As a —> 1 , oL —y 1, and the Integral in this last equation tends to zero, 
so that f{a) —> K(o,l). Hence If K(o,i) < 5 (o) < K(o,o) there exists 
an a, 0 < a < 1, for which f(a) = Ko), or 
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]kO 


u(a;oC,0) 


oti(O) + 




^ M(x,O) 0 j^(x)dx 


/ 


L(x, 0 )dP(x) 


where P= • Since /S= 0 , /L(x,l)dP(x) = u(a;ii.,0) also. 

Now for this same a let G = where jr = (i + • 

Since / L(x,y)dF(x) = uCajoL.o) for a < x ^ 1 and x = 0, we have 


(1 . 16 ) 


J*L(x,y)dP(x)^ dG(y) 


u(a;(i,0) . 


On the other hand 


(1 . 17 ) 


J*L(x,y)dG(y) ) dP(x) = c<.J^L(o,y)dG(y) + (1 - i!l)w(a;ir,0) 


and 


(1.18) jL( 0 ,y)dG(y) = afi(o) + J^K(0,y)ra(y)dy > KMd.O) + J^^^l ,y) Ya(y)d5f 

since KO) > K(0,1) > M(1 ,0) and K( 0 ,y) > K( 0 , l) > M( 1 , 0 ) > M (1 ,y) . By 
(1.8) (with <f = 0 and x = 1) the last quantity in (1.18) is w(a;a',0), 
so that combining (I.l6), (I.IT), and (l.l8 ) yields u(a;ol,0) > w(a;y,0). 

However taking y = 0 produces the inequality 
u(a;dL.,0) < w(a; 0 ,cr), for if G - (YQ^ycTI^) then 


u(a;(*.,0) - J J'L(x,y)dF(x)dG(y) = oLJ^L( 0 ,y)dG(y) + (1 - oL)w(a; 0 ,cr) 

Ja K( 0 ,y)Y^(y)dy] + (1 - cl)w(a;0,cf) 


= ol[cfK(0,1 ) + 


< oLw(a;0,c^) + (1 - oi)w(a;0,<J') = w(a;0,cf) . 


Since the two extreme choices of y and cT yield opposite inequalities 
there exists a pair of values y and cT for which u(a;«^,0) = w(a;K,cr). 
The verification of the optimal nature of the strategies P = (oCi^,(|)^(x)) 
and G = ()flQ,Yg^(y) ) is now straightforward and similar to the last 
part of the argument in Lemma 1.10. 


LEMMA 1 .1 6. Statement M of Theorem 1 . 1 . 


PROOF. Similar to Lemma lO. 

Uniqueness . The optimal strategies of the specified types have 
now been exhibited and there remains only the question of uniqueness. In 
Cases A and J it is easily verified via condition (c) that the solutions 
are unique. Prom the remaining cases we shall select Case (P) as typical, 
and show uniqueness in this case. Any other case can be handled similarly. 
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LEB 4 MA 1 .17 • If P r^resents any optimal strate¬ 
gy for player I, then the spectrum of P on the in¬ 
terior of the unit interval is continuous. 


PROOF. Since we already have an optimal strategy 
G = ()(lQ,yg^,d'I^) for player II for which / L(x,y)dG(y) < v for 
0 < X < a, the spectrum of P must be confined to the interval [a,l] 
and the end point o. Consider any y^ with a < y^ < 1; then 
/ L(x,y^)dP = v while / L(x,y)dP(x) = v for a neighborhood of y^. By 
bounded convergence, we get 


y-^y^ 

Similarly / L(x,y“)dP(x) - v. 


llm I L(x,y)dP = j L(x,y’I‘)dP == v - 

-♦y + ^ J ^ 


The difference gives 


fK(yo.yo) 


M{yo,yo)] P = 0 . As we have 


o' F = 0. The case where 


yo = ^ 


can be Iriandled similarly. In fact, one 


has [(Ka) - K(a,a)] = 0 and [$(a) - M(a,a)] < o. Since 

K(a,a) > M(a,a) we deduce from these two relations that (r* P = 0. 

cl 


LEMMA 1 .18. Under the conditions of Lemma 1 . 17 , 
then P is absolutely continuous for a < x < 1 and 
P* = f is continuous. 


PROOP. By virtue of Lemma 1 . 17 , we know that P = (<x.Iq,Pq(x) ,yfll^) 
and the spectrum of P^ is continuous and confined to a < x < 1 . Also, 


( 1 .?o) 




L(x,y)dP(x) = o(K(0,y) + 




L(x,y)dPQ(x) 


^M(1 ,y) 


for a < y < 1. An Integration by parts furnishes with the aid of the 
continuity of P^ for this Interval that 


(1 . 21 ) 


/L(x,y)dP^(x) = Jy K^^dx + iyr„(x)dx 

+ [K(y,y) - M(y,y)] PQ(y) + c . 


On account of K(y,y) > M(y,y), this equation and (1 .20) show that PQ(y) 
is absolutely continuous. Upon differentiation of (l.2l), one finds that 

I y y 

Pq = f is also continuous for a < x < 1 . 


LEMMA 1 . 19 * The optimal strategy for player I is 
unique. 
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PROOF. Since we are considering Case (P), we know that optimal 
strategies of the form P = > G = exist with 0 , 

a < 1 . By the preceding lemmas, any other optimal strategy P* for 
player I has the form P* - ^" where P^ is absolutely 

continuous, is confined to the Interval [a,l], and has a continuous 
derivative Pq = f on a < x < 1 . Now must be zero, for if not, then 

V - L(x,l)dP*(x) = d^K( 0 ,l) + K(x,l)dPQ(x) 

V = J*o ,y)dG(y) « yM(l ,0) + <yt(i) + J*a ,y)Yg^(y)dy 

since both and are non-zero; on the other hand 

V = 0l,K(0,l) + K(x,1)cIPq(x) 

v = J'M(i,o) +d’K(i,i) + M(i ,y)ra(y)dy 

by continuity. But the first and third equations imply 1 ( 1 ) = M(l,l) and 
the second and fourth ^(i) == K( 1 , 1 ), which is impossible since 
K(l,l) > M(l,l). 

Thus we see that f - P^ satisfies the integral equation (1.2) 
with ^=0, and since the solution of this equation is unique (oC is 
uniquely determined b^ / = 1 - oC), we must have F* = P. 

LEMMA 1.20. The solution for player II Is unique. 

PROOF. In a similar manner it is easy to deduce that the form 
of any optimal strategy is G = (yi^,'|^(y) ,<ri^) with Yg^(y) a density 
function for a < y < i . It follows that Y and cT are determined by 
;y^=1_X-rf and X(|)(0) + K(0,y)Yg^(y) + rfK(o,l) = v where 

=* XM'j + (fVg. If the solution to these equations were one dimensional, 
then there would exist a solution with y = o, cT > o. But the monotonicity 
criteria yields that 

K(0,y)y(y) +rfK(0,l) < v 

which is a contradiction. Thus the solution of the above linear equations 
is unique. This immediately implies the conclusion of the lemma. 

PROOF OP THEOREM 1 . 1 . Lemma 1 .2 to Lemma 1 .20. 

Additional remarks . 

A. If K(x,y) and M(x,y) are both separable functions 
(K(x,y) * ri(x)s^(y) etc.) then it can be shown that the integral 

equations producing the continuous portion of the optimal strategies may be 
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replaced by differential equations. 

B. If the kernel Is symmetric l.e., K(x,y) * -M(y,x) and 
$(x) = 0, then the only type strategies that appear are (A), (C), (G) 
or (J) . 

C. If \(x,x) > M^(x,x), and 

then the transformation transforms positive con¬ 

tinuous functions Into continuous monotonlc decreasing functions. Indeed, 
we differentiate 


V 


/: 






g(y)dy 








g(y)dy 


getting 


di| 




(/M^g + K^g) 





The hypothesis clearly Imply that ^(U^g) < o- Since U^^g Is continuous 
and pLOsltlve, we thus deduce that the optimal Y^iy) is positive con¬ 
tinuous and decreasing. In fact, YQ^(y) = Sn=:0 ^ term of which 

has the desired property. 

In order to insure that the optimal <l>g^(x) shall be positive and 
decreasing It is sufficient to assume that > o, M^y ^ o, Ky(y,y) > 

My(y,y) and K'(^.f) > M'(. 

An example where these conditions are fulfilled is 


L(x,y) 


^ K(x,y) « X - (1 - x)y x < y 

^ i(x) = 0 

^ M(x,y) = -y + (1 - y)x x > y . 


Thus, one can conclude that the absolutely continuous part of the optimal 
strategy for either player for this kernel Is continuous and decreasing. 

In this particular example the absolutely continuous distributions consist 
of Inverse cubics. 

Many other such examples can be constructed. 

D. We remark that if all the Inequalities in condition (c) are 
reversed, then the form of the optimal strategies are obtained by Inverting 
the unit Interval. (Replacing x by 1 - x and y by i - y.) 

E. Concerning the statements E to I of Theorem 1, some informa¬ 
tion can be given about the change of the interval [a,l]. Iirpllcltly 
contained in the proof of Theorem l Is the fact that as §(o) traverses 
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the range from K(0,0) to to M(0,o) the point a Increases from o 

to a maximum value a^ < 1 and then decreases from a^ to 0. In a 
similar manner it can be shown that pertaining to statements J to N as 
$(o) traverses K(o,o) to K(o,i) to M(l,o) toM(o,o), then a in¬ 
creases from 0 to 1 remains at 1 while M(i,o) < $(o) < K(o,l) and 
then afterwards decreases from 1 to 0. 

p. A remark concerning the result when $(l) and $(0} c?o not 
lie between and K(o,o), M(o,o) respectively is in order. 

It turns out that in this circumstance optimal strategies may not exist 
although the value is determined in the sense that inf sup = sup inf. 

G. The kernel (1 .1) represents the payoff of a game of timing 

with some kind of partial Information as to the time or method of action. 

It is therefore not surprising that the optimal strategy should involve 
partly a density. However, if the game of timing has complete Information 
then the optimal strategics behave very much like pure strategies. A game 
of complete information gives rise to a kernel of the following form: 

J m(x) X < y 

L(x,x) X y 

^ n(y) X > y 

where C > m' (x) > cf > 0 and -C < n’ (x) ^ - «f< o. Also, in(l) > n(l) 

wliile in(0) < n(0) and L(x,x) Is bounded but otherwise arbitrary. 

The monotonicity properties of ra and n imply the existence of 
a unique a^ with 0 < a^ < l so that m(a^) = n(a^). We now establish 
the following proposition; 

THEOREM 1.2. The game (l.22) has a value 
V = m(a^) = and the optimal strategies P and 

G are as follows; If L(aQ,aQ) > v(L(aQ,aQ) < v), 

then P == Ig^ (G = Ig^ ) while the player II (player I) 
o ^o 

has no optimal attainable strategy. Moreover if 

= V, then the point (a^ja^) is a saddle 

point. 


REMARK. We shall treat the kernel (1.22) as a limiting case of 
the kernel (l . l) . A different proof of Theorem 1.2 was given by written 
communication by I. Gllcksberg. It is felt that the procedure followed 
here is more natural. In addition, v/e slriall drop below the assumptions 
about the values of m and n at O and l and indicate the form of 
solutions for the more general game. 
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PROOF. Let L*(x,y) be any game of type (1.1), and consider the 
new games defined by the kernels L^(x,y) = L(x,y) + ^ L*(x,y) for 
k = 1, 2, .... It Is clear that L^(x,y) has the properties of the kernel 
of equation (1 .1) . Explicitly 


Lj^(x,y) 


m(x) + ^ K(x,y) 
L(x,x) + ^ $(x) 
n(y) + ^ M(x,y) 


X < y 

X = y 

X > y . 


The assumptions on m(x) and n(y) require that for sufficiently large k 
we have an Xj^, 0 < Xj^ < 1 , for wMch m(x^) + ^ L(xj^,Xj^) = 
n(Xk) + f M(x^,x^), and clearly x^^ —> a^. In view of Theorem 1 .1 (we 
have Case A, B, or C) the form of the unique optimal strategies for the 
game Li^(x.y) Is < ’ 

and only one of the pair is non-zero. For definiteness we may 

assume that ^ ^ infinite set of indices, and, replacing our 

sequence by a subsequence we may assume that ~ ^ for all k, a^^ —■> a, 
and that, if v^^ denotes the value of the game Lj^(x,y), v^^ —> v. 

Since x^ < a^^ < 1 and x^ —> i ^ ' moreover since 

Vj^ —y V we may conclude that v is the value of the game L(x,y), that 
is 

(*) inf sup J"J'L(x,y)dF(x)dG(y) - v = sup inf J J'L(x,y)dF(x)dG(y) . 

for, since Lj^(x,y) converges uniformly to L(x,y), 

j L(x,y)dPjj(x) >v-g, v+£> J’L(x,y)dGi(.(y) 

for k>k(€,), and {*) follows. 

We may now show that the value v of the game Ii(x,y) Is 
m(aQ) = n(aQ). By (1 -2) for ajc < 7 < ’ «« have 

( 1 . 23 ) n’(y) J*y it)g^(x)dx + (m(y) - n(y) )<|)g^^(y) + = o 

where <^(y) tends uniformly to zero as k —> ». In view of Belly's 
Selection Theorem we may (again replacing our sequence by a subsequence if 
necessary) assume that there exists a distribution F^ for which 
p^(x) —> Fq(x) for every point x of continuity of F^. Consequently, 
for y > a + > 0, we have 
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where £j^(y) tends uniformly to zero, and hence 


/y 


(1 - Fj^(t))dt = 1 - F^Cy) 

J J._TS _ri* (-t_) 


at every point y of continuity of F^. Since ^(t) -- m T r bounded 

for t > a + > a^, this Implies by a classical argument that PQ(y) = 1 

for y ]> a + cT. Indeed 


1 - Po(y) < M Jy (1 - Fo(t))dt 

yields, upon Iteration (valid since the points of discontinuity of F^ 
form a set of measure zero), 

„n/- „\n-l 

since cP > 0 la arbitrary PQ(y) = 1 for y > a. Por y < a, Pj^Cy) = 0 
for k > k(y), hence Po(y) = o, and P^ = Moreover, we may now 

assert that a = a^, for otherwise, since m(y) > n(y) for y > a > a - 
we conclude from ( 1 . 23 ) that the functions are bounded, so that ^ 

cannot converge to 1^. 

Now for y > a^, / L(x,y)dPjj(x) —> v; consequently 

V = yL(x,y)dPQ(x) = L(ap,y) = m(a|^) = n(ajj) . 

Now suppose P Is optimal for the game L(x,y). Then we may 
assert that P(x) =0 for x < a^. Por If x^ < a^^, P(Xq) > 0, then 
since aj^ —> a^, / L(x,y)dGjj(y) = m(x) ^ rntx^) for x < and k > k^. 
Moreover, since I,jj.(x,y) converges \inlformly to L(x,y) and Vj^—> v, 
for any t > 0 we have, for k > k{€), 

J L(x,y)dGjj,(y) < v + £ 

for all X. Now - x^) < m(aQ) - m(Xj^), and If we set 

£ = j P(xQ)<y(aQ - Xq) > 0 we have 

J J L(x,y)dGi^(y) < mCa^) - = v - <f(a^ - x^) 

for X < Xq. Consequently, for k > k(£), 

J J’L(x,y)dGij(y)dP(x) < P(Xp)(v - S(a^ - x^)) + (1 - P(Xq))(v + £) 

< P(Xq)(v + £ - <r(aQ - Xq)) + (1 - P(Xq))(v + fe) 
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< V + £ - F(x^)^(a^ - Xq) 

< V - i P(xQ)rf'(aQ - Xq) < V 

SO that P could not be optimal. 

Since P(x) =0 for x < a , we may write P = + P^ , 

U o-Q 

where P^ is continuous at a^, ^1 ^^* 0 ^ “ ® P^(l) « 1 - Por y > a^ 

<jLm(a ) + m(x)dP^ (x) + n(y)(l - oL - P^ (y)) > v * mCa^) = 

J “o 

so that 

Jl (m(x) - in(aQ))dP, (x) + (n(y) - n{a^))(l - ct - P, (y)) > 0 . 

Since C(y - a^) > m(y) - ni(aQ) > cf(y - a^^) and P, Is continuous at a^ 

we have (in(x) - 01 ( 3 ^) )dP^ (x) ■= o(y - a^^); since 

n{y) - n(aQ) < - «l'(y - a^) < 0, we have 

0 < <f(y - a^Xl - - P, (y)) < - (n(y) - n(ajj))(l - A - P, (y)) 

< J’y (iii(x) - m(aQ))dP, (x) = o(y - a^) 

so that 1 - oC- P, (y) —> 0 as y —> a^. Thus P, (y) = 1 - ot for 

y > a^, and P, = (1 - + (’ - = ^a^^- 

A conipletely analagous argument applies to player II and shows 

that only I can serve as a solution. The remaining statements of 
^"0 

Theorem 1.2 now follow readily from these facts. 

REMARK. Let L(x,y) satisfy the conditions of Theorem (1.2) 
except that no requirement is imposed about the values of m(x) and n(x) 
at 0 and 1. Suppose moreover that L(0,o) and L(l,1) lie between the 
respective values of m and n at these end points. The optimal strate¬ 
gies are described as follows; (a) (i,l) is a saddle point if and only if 
m(l) < n(l), (b) (0,0) is a saddle point if and only if m(0) > n(o) and 
(c) for the remaining case the solution is given in Theorem 1.2. 

PART II 


(*) 


We analyze the following class of kernels 


L(x,y) 


K(x,y) 

M(x,y) 


X < y 

K(x,x) = M(x,x) 

X > y 
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satisfying the following conditions. 

(a) In their respective domains both K(x,y) and M(x,y) have 
continuous third partial derivatives. 

(b) Kj^^(x,y), Kyy(x,y) are strictly negative for x < y and 

Mxx' strictly negative for x > y. In other words K and M are 

each strictly concave in each variable separately on each side of the 
diagonal. The kernel L(x,y) is not however necessarily concave in each 
variable separately throughout the unit square. 

In all that follows we assume (a) ana (b) are satisfied. 

Butterfly Kernel . We examine completely liere first a specific 
case of the above kernel (*) which arises frequent]y in applications. This 
class of kernels was first Introduced by Gllcksberg and Gross. 

DEFINITION 2.1. A kernel of type (*) Is saia to 
be butterfly if in addition to the requirements (a) and 

(b) , we assume 

(c) The function K(x,y) is strictly increasing in y and 
strictly decreasing in x. Also, M(x,y) is strictly increasing in x 
and decreasing in y. In other words the kei'nel is mono tonic away from the 
diagonal. 

We establish here the following principal theorem. 

THEOREM 2.1. Both players possess unique solu¬ 
tions of the following form P ~ (oi.I^,(|) ,^31^) ariu 
G = (iri^,Y,<ri^) where (|) and Y are absolutely con¬ 
tinuous over the full interval and are obtained as the 
unique solutions to a pair of Integral equations. 


Ol-P, + /3p2 ■= I* - Tif 


= jl Ky(y~^^(y!y) ^ 

-My„(x,y) r. -I!L (x,y) 

'= J o M^(x;x)-K^ - ( x ; 7r ^ J x m^(x,x)-k^(x,x) 

^(0,y) -IVvd.y) -Mxx(’''°) . -Kxx^'^d) 

rs A / ■ j —rrv. = -tts ??— tttz — 


(Ky-K^) (y,y)' Pa = (Ky-R^) (y,y) ’ 


The solution of these integral equations can be obtained by the 
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use of Neumann Series. For clarity of understanding, we shall divide the 
proof into a series of lemmas. 

REMARK. The operators T and U constitute strictly positive 
operators which transform positive continuous functions into continuous 
strictly positive functions. The properties enunciated in Part I for such 
operators are valid for T and U. Finally, the operator Tg^^ etc. shall 
denote the same operator T except that the integration is extended over 
the interval a < x < h. 

LEMMA 2.1. The radius of the spectrum 
A(Tq^) [>i(Uq^)] of the operator T [U] is less 
than 1. 

PROOF. If we assume the contrary, then ) > 1 . As we let 

a —> 1, then A(Tg^) —> 0. By Property II of positive operators there 
exists an a for which A(Tg^) 1. Property I guarantees a non-negative 
eigenfunction f(x) such that T^^^f -= f. Upon integration of Tf - f, 
we get 

^ Ky(x,y)f(x)dx + M^(x,y)f(x)dx = c 

for a < y < 1 . Setting y = a, as M^(x,a) < O, we have c < 0. On the 
other hand if we put y = i, then as Ky(x,i) > o, we secure tliat c > o. 
This contradiction establishes the assertion of this lemma. A similar 
argument applies to the operator U. 

Lemma 2.1 enables us to Invert (2.1) and (2.2) for any non-nega¬ 
tive ot, /s, y, and we produce positive continuous functions. Explicitly, 
let (I - T)'’p^ - 1=1,2 ana (I - = 1)^ 1 = i, 2. Put 

(|) = and VJYi + cTVg* 

lemma 2.2. There exists optimal strategies of the 
following form F = (<AI^,<t)(x) ,^I^) and G = (KlQ,Y‘,cri^). 

PROOF. We suppose that all the quantities have been defined as 
above. Integration once of (2.1) gives that 

(2.3) C = AKy(o,y) + /3My(l ,y) + Jl Ky(x,y)(|)(x)ox + J*’ My(x,y)(|)(x)dx ■ 

We choose oi and /S so that /il) = ol/$, + - ot-yfl. There 

exists In fact an entire Interval of values for which this Is fulfilled- 
Sv 5 )poalng first o(. = 0 and then letting y = 0, we obtain 
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c = /8My(l »0) J’o My(x,0)(|)(x)dx < 0 . 

In a similar manner, if we choose « 0 and look at y = 1, we secure 
that c > 0. Continuity thus produces a choice of ot > o and > o so 
that c = 0. Analogously, we find the existence of positive constants 
and d* so that 

( 2 A) 0 = IMjj(x,o) + JKjj(x,1) J'o ^(x,7)Y(7)dy + My(x,y)Y(y)cly 
An integration once more of ( 2 . 5 ) and (2 A) yields that 


L(x,y)dP(x) = b 


J' L(x,y)dG(y) = d 


P - (AIq,(|)(x),/3I, ) 


G - (xiQ,y(x),rfi,) 


Multiplying the first by dG and the second by dP and integrating shows 
that b * d = V. It remains only to establish the uniqueness. 

IiEIMMA 2 . 3 • If F is optimal for player I, then 
on the interior of the unit interval P is continuous. 

PROOF. Let y^ be any point where 0 < y^ < 1 . Since F is 
optimal, we have f L(x,y)dF = v for all y. Thus 

f L(x,y)-L(x,y ) 

J - y-y^ ° y ^ yo • 

As the right-hand derivative exists everywhere and is bounded, then with 
the aid of bounded convergence, we get J 1, (x,y^)6F == 0. Similarly, we 

obtain I Ly_(x,yQ)dF = 0. Since Ly^(x,y^) = Ly_(x,yQ) except for 
X = y^, we have 

0 = J (Ly^-Ly_)(x,yQ)dP(x) = (KyCy^.y^) - . 

Thus <r P - 0 and the proof is complete. 


LEIMMA 2.4. If P is optimal, then P is abso¬ 
lutely continuous and P* = f is continuous for the 
points where o < x < i . 


PROOF. Since P is optimal, we have 
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( 2 . 5 ) vs J L(x,y)dP(x) « ot^K(o,y) + ,y) 

+ fl K(x,y)dP^(x) + J; M( x,y)dPQ(x) 

where Pq(x) represents the continuous part of P(x) concentrated on the 
Interval of 0 to l . An integration by parts of the last two Integrals 
gives 

( 2 . 6 ) K(x,y)dPo(x) + J’y M(x,y)dPQ(x) = - Jo K^(x,y)Po(x)dx 

- J^ M^(x,7)F^(x)dy + M(i .y)Po(l) . 

This formula Is valid by virtue of Lemma 2.3 which established the con¬ 
tinuity of PqCx). Differentiating ( 2 . 5 ) after ( 2 . 6 ) has been substituted 
Into ( 2 . 5 ) yields 

( 2 . 7 ) 0 = <^Ky( 0 .y) + + Po(l))My(l,y) - Jj K^o^’' - fy “x/o*^* 

- [K^(y,y) - M^(y>y)] • 

Since (2.7) by assunption (a) that F^Cy) is 

absolutely continuous. Upon differentiating once more which is valid by 
assumption (a), we obtain that PQ(y) ~ f(y) Is continuous. 

lemma 2 . 5 . The optimal strategy for player I is 
unique. 

PROOP. Lemma 3 shows that any optimal strategy for player I has 
the form P{ot,f(x),j6) with f(x) continuous for o < x< 1. Differ¬ 
entiating f L(x,y)dF = V twice establishes that f satisfies equation (l) 
l.e.. 


otp, + /3P2 “ f - Tf . 


Clearly f = ot(|i, + Mg- It remains to show that there exists a unique pair 
of positive quantities d, /3- satisfying 


( 2 . 8 ) 

and 

(2.9) 




olKy(0,y) +^My(l,y) + Jy Ky(x,y)f(x)dx + Jy My(x,y)f(x)dx 


0 
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with f(x) = cL(|)^ + solution to those two equations Is one 

dimensioml, then there Is a solution of the form ol> 0, ^ = 0. However, 
this Is Impossible for then by taking y 1# we obtain that the relation 
(2.9) Is strictly positive. 

PROOF OF THEOREM 2.1 , This Is the content of Lemma 2.2 and 
Lemma 2.5 w.Ith a dual proof to Lemma 2.5 establishing the uniqueness of the 
optxmal G strategy. 

We close this section with some adaltlonal remarks. 

If L(x,y) Is a butterfly kernel and L(x,y) = L(y,x), then the 
unique optimal strategy for each player coincide. This is due to the fact 
that the integral equations wliich produce the solution are the same. 

We now present a few examples of butterfly kernels, specifically, 

(a) L(x.y) = |x - y| - A(x - y)^ where 0 < A < ^ 

(b) L(x,y) = max(in(x)n(y), n(x)in(y)) 

with tn(x), n(x) > k > 0 , rn'(x) < -k < 0, n'(x) > k > 0, and in"(x), 
n''(x) < -k < 0. 

Kernels concave on each sloe of the dlaROnal . In this section, 
we drop assumption (c) and suppose only that (K^ - My)(y,y) ^ 0 arid 
(M^ - K^)(x,x) > 0. This incluaes the case wherein the kernel has 
butterfly shape only in the nclghborhoou of the diagonal. 

THEOREM 2.2. Unaer the conaition stated above all 
the optimal strategies have the following form: There 
exists a unique Interval [a,b] such that any maxi¬ 
mizing strategy F = ,fi\) and any mini¬ 

mizing G= (KlQ,yg^^(y) ycTI^) where ol > 0 when 
0 < a < 1 and >8 > 0 when 0 < b < 1 . Generally, <±, 
fi, y, > 0 and y'a.b obtained as the Neumann 

Series or eigenfunctions to associated integral equa¬ 
tions. There exists at most a one dimensional set of 
solutions for each player. 

The proof of this theorem is subdivided into a series of lemmas. 
Although an analagous method to that used in the study of butterfly kernels 
can be employed to treat this case, we follow a different procedure which 
is also applicable to the preceding section. Both approaches have their 
individual merits and are useful for different particular examples. 

LEMMA 2.6. There exists a unique interval [a,b] 
which is the spectrum of any optimal strategy for the 
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maximizing player. If this Interval is non-degenerate, 
it is, with the possible addition of 0 and 1 , the 
spectr-um of any optimal strategy for the minimizing 
player. If a = b, then the spectrum of any optimal 
strategy for the minimizing player is contained in 
(o,a,l). 

PROOF. We shall let F and G represent optimal strategies for 
the maximizing and minimizing players, respectively. If (c,d) is any 
open Interval of F measure zero with 0 < c < d < 1, it is easily seen 
that / L(x,y)dF(x), which is > v, is strictly concave for c < y < d, 
hence )> v in this Interval. Consequently the spectrum of any optimal G 
cannot meet this interval, and the spectrum of any optimal G is contained 
in the spectrum of any optimal F, with the possible exception of the end 
points 0 and 1 . 

Now suppose c and d are in the spectrum of F, c < d, and 

(c,d) is of F measure zero. Then (c,d) is of G measure zero for any 

optimal G, so that / L(x,y)dG(y) is strictly concave for c < x < d. 
Since this integral is a continuous function of x and must assume the 
value V at c and d we have / L(x,y)dG(y) > v for c < x < d, which 
contradicts the optimality of G. Hence the spectrum of any optimal F is 
some closed interval [a,b]. 

Suppose that for some optimal F this interval is non-degenerate, 
L.e., a < b. Then [a,b] Is contained in the spectrum of any optimal G 
since / L(x,y)dG(y) = v for a < x < b so that no open subinterval is 

of G measure zero. Combined with the fact that the spectrum of any G 

Is contained (disregarding o and i) in the spectrum of any F, this 
inplies ttiat the spectrum of any optimal F* coincides with (again dis¬ 
regarding 0 and 1) that of G, so that [a,b] is the spectrum of all 
optimal F, ana similarly of all optimal G (again disregarding 0 and 
1) . 

If on the other hand [a,b] is degenerate for all optimal F, 
it is still unique. For suppose I_ and I„, are optimal, a 5 ^ a*. Then 

ck cL 

since the spectrum of an optimal G is contained in { 0 ,a,l) and 
( 0 ,a',l}, the spectr-um of any optimal G is contained in { 0 , 1 } so that 
/ L(x,y)dG(y) is strictly concave for 0 < x < l, < v and yet equal to v 
at a and a', which is clearly absurd. 

LEMMA 2 . 7 . The maximizing optimal strategies have 
the form F = ,/Sl-j^) with oC > 0 when 

0 < a < 1, 0 when 0 < b < 1, and oL > 0 , /Sy 0 

otherwise. 
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PROOF. The identical arguments of Lemmas 2.3 and 2.k apply here 
and show with the aid of Lemma 2.6 for x interior to the closed Interval 
[a,h] that F(x) is absolutely continuous and P'(x) « f(x) is con¬ 
tinuous over the interval [a,b]. We now verify that if o < a < l, then 

P possesses an additional point spectrum at a. To this end, if we assume 

the contrary, then the derivative of h(y) == / L(x,y)dP(x) exists and is 
zero at a. Since h(y) is strictly concave for 0 < y < a, this implies 
the fact that / L(x,y)dP(x) < v for 0 < y < a which is contrary to the 
optimal character of P. A similar argument applies to the end point b 
if it is interior to the unit Interval. 

LEMMA 2.8. The minimizing strategy G has the 
form G = (y^o'^ab^^^ ^ with JT, rf > 0. 

PROOF. As in the previous lemma it is easy to deduce that G is 

absolutely continuous over the interior of the interval [a,b]. In view of 
Lemma 2.6 it remains only to show that if 0 < a < 1, then G is con¬ 
tinuous at a. As in Lemma 2.3, it follows that / L^^(a,y)dG(y) =0. On 
the other hand, we have / L(a,y)dG(y) = v and / L(x,y)dG < v for x < a. 
Consequently, / dG(y) > o for x < a. Proceeding to a 

limit gives that / L^_(a,y)dG > 0. Therefore, o > / (L^_^ - L^_) 

(a,y)dG(y) « (M^ - K^) (a,a)cr^G. Since M^^ - K^^ > 0 and cfg^G > 0, we 
deduce g-g^G =0. An analogous argument applies at the point b if 
0 < b < 1. Indeed, / L^_(b,y)dG(y) = 0 and / L(b,y)dG(y) = v while 
/ L(x,y)dG(y) < v for x > b. Whence / L^^(b,y) < 0. Therefore, 

0 > / ~ ■ 

Again, this gives that ^(Gr) = o. This completes the proof of the lemma. 

Upon two differentiations of L(x,y)dF(x) = L(x,y)dG(y) = v 
for a < X, y < b, we obtain for 0 - (|)g^^ and Y =* that 

(2.8) 0 = (^Kyy(a,y) + /3Myy(b,y) + J"| Kyy(x,y)(l)(x)dx + 

J y Myy(x,y)(|)(x)dx + (Ky - My) (y,y)(|)(y) . 

( 2 . 9 ) 0 = ^ \^(x,y)Y(y)dy + 

J*^ Kj^x(x,y)Y(y)dy + (M^^ - K^)(x,x)Y(x) . 

Expressing these Integral equations differently, we get 

(2.10) dp^ + 
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( 2 . 11 ) 


rq, + = r- 


where 


T.b* - fl - . 


(Ky-My)(y,y) 

(Ky-My) (y.y) « 


- Ky^(^ - ' 

-Myy(b,y) 

Pa - Ky-J^(y,y) 


and 


f WL (x,y) A Ky (x,y) 

~ J a ~ Mjj(x,x)-K^(x,x) ^ J x ~ M^^CXjX)-Kj^CXjX) ’•^y^'^y 


" (M^-I^)(x,x) ’ 


-Kjj^Cxji) 

" (M^-K3j)(x,x) 


The two Integral equations (2.10) and (2.11) are to be used to determine 
(|)(x) and Y(x). The fact that and are positive implies that 

$ > Tg^^(|) and Y > Using again the general theory of positive 

operators [J] yields that MT^^) < 1 and ^(U^-^) < l . If either a or 
b are interior to the Interval [0,1], then A(Tg^^) <1. In fact. 

Lemma 2.7 guarantees that (2.10) is satisfied with at least oi or /9 
non zero and one concludes from this (since > cJ'> 0) that Tg^^(|) < 
with A < 1 . Thus A(Tg^^) < A < 1 . Concerning >t(Ug^), we have that both 
cases where ^^(Ug^^) = l and /^(Ug^^) < i may occur. 

Let 0 < a < b < 1 . 


CASE 1 . If /*(Ug^^) = 1, then the optimal strate¬ 
gies have the form F * 

G = (Yab^^^^ oL > 0 and ^ > 0. 

PROOF. Lemmas 2.6 to 2.8 have established that the optimal solu¬ 
tions have the form F « '^^b^ and G = («'lQ,Yg^^(x) ,^^11). If 

either jf or <r were not zero, then equation (2.11) would imply that 
>A(Ug^^) < 1 contradicting the hypothesis. 

Let 0 < a < b < l . 

CASE 2. If /^Ug^^) < 1, then the form of the 
optimal strategies is as follows: F = (^^a'^ab^^^^^^b^ 
and G = 0(lQ,V^^(y) ,tfl^) with ot, ^ > o and at least 
K or positive. 


PROOF. The demonstration is similar. 
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Let 0 < a < b == 1 . 

CASE 5. If = 1. then P = Wa^^^ab^^^'^^b^ 

and G = (Yai 3 (x)) with <i. > 0 and /3 > 0 and at least 
if or <r positive. 

The proof of this is similar to the preceding. An analogous set 
of results presents Itself when 0 = a < b < 1 and 0 = a < b = 1 . 

We finally remark that when Y > o in any of the above strategies, then 
this inposes a condition on the yield / L(x,y)dP(x); namely 
/ L(x,o)dF(x) = V = / L(x,a)dP(x). A similar requirement results when 
> 0, i.e., I L(x,i)dP(x) = / L(x,b)dP(x) = v. These conditions 

determine a and b uniquely. 

We now discuss the question of uniqueness. Whenever at least a 
or b is interior to the unit Interval and there exists an optimal mini¬ 
mizing strategy using both end points o and l, then we show that the 
maximizing strategy is unique. The proof of Theorem 2.2 has shown that 
any optimal strategy for player I has the form P = (oLIg^,(l)g^^(x) with 

it)at|(x) = + /Si|)g(x) where (1 - = 0^^ and 1=1,2, . 

We must verify that the choice of d. and fi are unique. Por any values 
of dL and fi which supply optimal strategies it follows that 

0 = oLKy(a,y) + ^My(b,y) + J*! Ky(x,y)0ab(x)(ix 
for a < y < b. 

This has the form oiR(y) + fiSij) = 0. Explicitly 
R(y) = Ky(a,y) + l.y(x,y)0, (x)dx and S(y) = t(^(b,y) + Ly(x,y)02(x)dx. 

Prom the properties of the Integral operators it follows that R(y) = c^ 
and S(y) = Cg. If R(y) or S(y) is not zero, we get a one dimensional 
set of solutions for d . and /3. The normalization l - cl - ^ = 

/ $-1 + ^ / $2 Pro^^ces a unique choice of (<i,/3) in this one dimensional 
set. We may hence assume that R(y) = S(y) = o for a < y < b. The 
assumption on the minimizing strategy lii 5 )lles for any optimal P that 
/ L(x,0)dP(x) = V = / L(x,y)dF(x) for a < y < ti- Expanding this equality, 
we get oik^ + ySkg = o with another similar relation cLl^ + /31g = o, re¬ 
sulting from consideration of the point 1. It is to be emphasized that the 
constants k^ and kg do not depend upon d. or fi- These equations 
cannot possess a two dimensional set of solutions for then there would 
exist an optimal P strategy with no jump at either a or b which con¬ 
tradicts Lemma 2.7- The normalization again selects thus a \inlque pair. 

If = 1, the uniqueness of the optimal strategy for the 

minimizing player follows from the fact that any solution of the form 
(YI^^Tg^l^Cy)) ,<fl^) with say Y > o Implies < i and the eigen- 



REDUCTION TO INTEGRAL EQUATIONS 


157 


function is unique (Property I of strictly positive operators). We have 
been able to verify In every particular exanple the uniqueness. However, 
the uniqueness question in general remains open. The fact that we get at 
most a one dimensional set of solutions follows since they all satisfy the 
same Integral equation. In fact, range only over a one dimensional 

set since the additional normalization restricts one of the variables. 

An example . We Illustrate the theory of the preceding section 
by the following example. Let 

r K(x,y) = y - X - A(x - y)^ y > x 

L(x,y) = J A > 0 . 

M(x,y) = X - y - A(x - y)^ x > y 


It Is easily verified that = My^ = -2A and 

Ky = 1 + 2A(x - y). My = -1 + 2A(x - y). Furthermore, it is easy to 
show that this kernel is Invariant under the transformation x —■> i - x 
and y —■> l - y. It therefore follows that there exists optimal strate¬ 
gies P(x) and G(y) which are unchanged under the mapping x —1 - x 
and y —1 - y respectively. Consequently, we search for a symmetric 
Interval about ^ to play the role of [a,b] . The solution to the 
integral equation 


A = 





inplles that $( ’'J 

If we consider the equation oLp^ + ySp^ = i? - T^^^^ with fi = d, 
we get 5 - A and The condition / L(x,0)dP = / L(x,a)dF 

ln 5 )lles after a simple calculation that either c = i or c = This 

gives that a = i - and 13 = ^^ when c = and a == o, b == i when 

c = 1 . For 0 < A < 1 the operator T(|) = / A(|) has A(T) < 1 while for 
1 < A< 2, we have A(T) > 1 thus to generate a positive operator of 
spectral radius less than 1 it suffices to take the interval (1 - 
for 1 < A < 2. If we compute c*. for the two cases we get cL = when 

0 < A < 1 and cL = when A is between i and 2. We have therefore 

found the form of the strategies to be for o < A < l 


P - (^ 2 ^^ ^o'^ol ' 2 ^ ^1 ^ 
G= io,Voi(y).^ 1,) 


^01 = 




A , 


and for 1 < A < 2 



158 


KARLIN 


(¥i, ■ 1 . I-’) 

'A “ A A 

G = ("^ ^o> 'K T (y)» * 

7C' A 

For A > 2 one verifies directly that the 

F - (ip and G = (~ ^ I,) 

2 

and the value is equal to ^ - A(^)^. In all these cases of this exaji^jle 
it can easily be shown that these optimal strategics are unique. 
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ON A CLASS OP GAJyiES 
Samuel Karlin 


The purpose of this note is to describe qualitatively the nature 
of optimal strategies for a payoff kernel K(x,y) defined on the unit 
square satisfying Ky^^y(x,y) >0 with n partial derivatives taken with 
respect to y. We present a complete analysis for n < 4. However, the 
method employed seems to extend easily and should enable one, by enumerating 
cases, to analyze the situation for general n. Specifically, we show that 
for n = 5 and n = 4 the maximizing player has optimal strategies in¬ 
volving respectively at most 3 points and at most 4 points of increase. 

For general n, it can be shown that the maximizing player has optimal 
strategies using at most n points. For the minimizing player the state¬ 
ment of the nature of an optimal strategy is more precise. There always 
exist for the general case optimal solutions using at most ^ points, with 
the understanding that the end points o or 1 when used are each counted 
only half. For example when n is odd, then ~ is a half integer and 
hence must use a single end point if a full optimal strategy exists em¬ 
ploying “ points. This counting procedure applies only to the minimizing 
strategies. 


^ 1. OPTIMAL STRATEGIES FOR PLAYER II 

We assume throughout this section that K^ y(x,y) > o in the 
unit square with n partial derivatives taken with respect to y and that 
K possesses continuous n^^ partial derivatives. 

LEMMA 1 . If Ky y(x,y) > 0, then there exists 
an optimal strategy for player II with at most - 
points of increase. 

REMAEIK 1 . It is sufficient to prove Lemma 1 when 
Ky. .y(x,y) > cT > 0. Indeed, if we perturb K by 

K^(x,y) = K(x,y) + ^ L(x,y) where Ly__y(x,y) > <r > o. 


The preparation of this paper was si^ported by The RAND Corporation. 
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then K^^Cx^y) converges iinlformly to K(x,y) and 

kP (x,y) > ^ <y ]> 0 for each n. The function 
j • • * y — n 

L(x,y) can be chosen to be an n degree polynomial 
In X and y with the coefficient of y^ a strictly 
positive polynomial for x ranging in the unit inter¬ 
val. Each kernel K^ possesses an optimal solution 
Gn for player II of at most ^ points in the spectrum. 

We can select a limit distribution G^ which also in¬ 
volves at most ^ points of Increase. Similarly, let 
P denote any limit distribution of optimal strategies 
P^ of the games K^(x,y). It follows easily that G^ 
and P are optimal strategies for players II and I 
respectively for the game with kernel K(x,y). 

PROOP OP LEMMA 1 . In view of Remark 1 we may assume that 
Ky y(x,y) > 0 for x,y traversing the unit square. Let Fq(x) denote 
an optimal strategy for player I, then the hypothesis and bounded conver¬ 
gence easily yields that h(y) = K(x,y)<^^(x) has h^^^(y) > 0 . This 

implies that h(y) can achieve a value at most n times since otherwise 
there exists a y^ with h^(yQ) = 0. Consequently, the minimum m of 
h(y) can only be achieved at most ^ times, end points being counted half 
as described in the introduction; for otherwise m + £ with e sufficient¬ 
ly small would be taken on at least n + 1 times. Since an optimal strate¬ 
gy for the minimizing player can only concentrate at these points, the 
conclusion of the lemma is now evident. 

f 2 . OPTIMAL STRATEGIES POR PLAYER I WITH n * 1 AND 2 

The case n = 1 yields a saddle point. In fact if denotes 

a point where K(x , 0 ) « max K(x,0), then it is easily verified that 

X 

X = Xq and y = 0 is a saddle point. 

LEMMA 2 . Let X be compact and Y an n dimen¬ 
sional simplex. If M(x,y) is a continuous payoff 
kernel defined on X x Y which for each x is a con¬ 
vex function in y, then there exists an optimal 
strategy for player I involving at most n + 1 points 
of Increase. 

This lemma cornprises the essential result of [ l ] . Por a more 
direct and illuminating proof see a forthcoming paper by the author on the 
general theory of Infinite games. 

The content of Lemma 2 contains the case of n « 2 being analyzed 
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in this paper. Player II has a pure optimal strategy while player I pos¬ 
sesses an optimal solution using at most 2 points in its spectrum. 

^ 5 • OPTIMAL STRATEGIES FOR PLAYER I WITH n = 5 

Throughout this section we assume that Kyyy(x,y) > 0 and we 
establish the following theorem. 

THEOREM 1 . If K possesses continuous third 

partial derivatives and Kyyy(x,y) > 0 for 

0 < x,y < 1, then player I has an optimal strategy 

P with at most 5 points of Increase. 

The proof of this theorem will consist in analyzing the various 
possibilities. It is no loss of generality to suppose that Kyyy(x,y) > 0. 
An argument analogous to that used in remark 1 establishes this fact. 
Moreover, any optimal minimizing strategy Involves at most 3/2 points. The 
various possible minimizing strategies are therefore of the following forms, 
where 1^ denotes a pure distribution with full weight at y: (a) dl^ + 

(1-d)T ^ with 0 < y^ < 1, (b) oLI + (l-d)l (c) I with 

Jq ^ ^ ' •'0 

0 < Jq ^ ^ ^o strategies listed above present 

an en-umeratlon of all the possible ways of obtaining ^ > or 1 “ 
points, with the exception of one. It remains only to show why an optimal 
strategy of the form dl + (l-d.)i with 0 < y^ < i cannot occur. 

(A) In fact, if P(x) is optimal for player I, then 
H(y) = /q K(x,y)dP(x) has the properties that h( 1 ) = hCy^) = v, h(y) > v, 
and h»*'(y) > 0 . This implies that h is convex in the neighborhood of 
y^ where h attains a minimum and further, since h( 1) = v, that h is 
concave at y^ > y^. Thus IV ^(j^) >0 and h**(y^) < 0 . But since 
h'’'(y) > 0 , it follows that h**(y) is Increasing which is incompatible 
with the preceding remark. 

In general, once the yield h(y) = K(x,y)dP(x) is convex then 
it cannot turn back and become concave. 

To establish the assertion of Theorem 1, we shall show for each 
of the possible forms of an optimal solution for player II that player I 
possesses an optimal strategy of the desired type. 

Case (a). Since = dl^ + ( 1 -^) 1 ^ is optimal for player II, 

any value x occurring with positive probability in an optimal strategy P 
must imply that K(x,y)dGQ(y) = v. Let X be the set of all x for 
which /q K(x,y)dGQ(y) = v. Evidently, the set X is compact. We now 
Introduce the following auxiliary game defined for x in X and z 
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ranging over a 2 dimensional simplex Z spanned by , Zg, and z^. 

For X in X, set M(x,z^) » - v, where Is the value at 1 of 

the tangent line to K(x,y) at y^, M(x,Z 2 ) = Vg - v, where v^ is the 

value at o of the tangent line to K(x,y) at y^, and 

M(x,Zj) == K(x,0) - V. Extend M(x,z) linearly over Z for each x. 

It is easy to verify that the hypothesis of Lemma 2 are satisfied. Also 
if P is optimal for the game K(x,y), then M(x,z)dP(x) == o. There¬ 
fore, there exists an optimal P*( * ^ ^ which 

M(x,z)dF*(x) > value > 0. We consider h(y) = K(x,y)dF*(x) . The 

interpretation of the game M(x,z) shows that the tangent to h(y) at y^ 
lies above v at 0 and 1 . Thus L(yQ) ^ v. Also, h(0) ^ v. However, 
since x^ , x^, and x^ belong to X, we obtain tliat v < h(y)aGQ(y) = 
/q qP*(x) /q K(x,y)dG^(y) = v. This yields that h(o) - h{:/^) = v and 
hence the slope h'(yQ) = 0. The argument of paragraph (A) shows that 
h(y) is convex at y^ and h(y) > v throughout. 

Case (b). Let X consist of all x for which 

V = /q K(x,y)dGQ(y) where Is optimal and of the form 

aIq + (1-o^)I^. Evidently, X is compact. Let M(x,z) be defined over 
the set X and the two dimensional sinplex z spanned by , z^, and 
Zj defined as follows. Put M(x,z^) = K(x,0) - v, MCxjZg) = K(x,l) - v 
and M(x,z^) ^ - Ky(x,l) with M(x,z) extended linearly over z. If 
Pq(x) is any optimal strategy for player I of the game corresponding to 
the payoff kernel K(x,y), then M(x,z)dF(x) > o. In view of Lemma 2 
we can find an optimal strategy F*(x) using at most 3 points x in X. 

If h(y) = K(x,y)dF*(x), then h(0) > v, h(l) > v and h*(l) < 0. 

Since GrQ(y) concentrates only at 0 and 1 and 

^o -^o = v we conclude that h(o) = h(l) = v. Further¬ 

more h'(y) is negative at 1 and h***(y) > 0 requires therefore that 
h(y) is greater than v throughout the unit Interval. 

Case (c). In this case an optimal minimizing strategy exists 
concentrating at the point y^. Let X conprise all x where 

K(x,yQ) « V. Again, we introduce the auxiliary game M(x,z) with x 
in X and z in the two dimensional simplex. Put M(x,z^) = + Ky(x,yQ), 
M(x,Z 2 ) = - Ky(x,yQ), and M(x,z^) = K(x,o) - v with the usual linear 
extension. An analogous reasoning produces an optimal strategy 
p*( ciI + + tl ) with Jy. M(x,z)dF»(x) >0. The function 

X^ r Xg Xj A 

h(y) = K(x,y)dP*(x) has the properties that h(yQ) = v, h»(yQ) = 0 

and h(0) > v. The argument in (A) and h(o) ^ v show that h is convex 

at y^ and since h(o) > v we easily find that h(y) > v for 0 < y < 1 . 

Case (d) . The form of G^ is 1^. We select for X all x 

where K(x,o) = v, and for some optimal F^ we set m(y) = / K(x,y)dFQ(x) 

Evidently m*»'(y) > o, so that m»* is strictly increasing, and we may 
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divide the analysis into the following exhaustive subcases; 


(d,) 

m'’(y) <0 

0 < y < 

(d,) 

m''(y) >0 

° < y< 

(dj) 

m" (0) < 0 < m* 

■(1) . 


(d^ . We define an auxiliary game M(x,z) as follows; 

M(x,z^) == - Kyy(x,l), M(x,Z 2 ) = K(x,l) - V. In this case Z is one 
dimensional, and by Lemma ? we can find an optimal strategy P* using 
two values x in X for the auxiliary game. Now h(y) = K(x,y)dP*(x) 
satisfies h*'(l) < 0 , h(o) = v and h(l) > v. Since h» * is increasing, 
h is concave. Since h(y) is no less than v at both ends of the unit 
interval, h(y) > v for all y, and P* is optimal for the original game. 

(dj^) . Since m(y) > v and m(o) = v, we must have m*(o) > 0 . 
Consequently, defining the auxiliary game by M(x,zp = Ky^(x,o), 

M(x,Z 2 ) = Ky(x,o), Z is again one dimensional and / M(x,z)dPj^(x) > 0. 

By Lemma 2 we have an optimal P* for the auxiliary game using two points 
in X, and for h(y) * / K(x,y)dP*(x) we have h’»(0) > 0, h»(0) > 0 

and h(0) « v. Since h'* is increasing, h is convex; combined with the 

fact that h(o) = v, h*(0) > 0, this yields h(y) > v, or the optimality 
of P* in the original game. 

(d^) . Consider the graph of m. Since m* * is strictly in¬ 
creasing we have a unique point of inflection y^, 0 < y^ < 1 , m* *(yQ) *= 0. 
For some y^ , y^ < y^ < 1 , the tangent line to the curve at y^ will have 

its value at 0 as well as its value at 1 > v. For if m'Cy^) > 0, this 

will be true for y^ = y^ since the tangent at y^ lies above the concave 

portion of the curve (where y < Yq) , and thus the height of the tangent 

line at 0 will be at least v *= m(0); since the slope of the tangent is 
non-negative this is also true at 1. On the other hand if m’Cy^) < 0, 
then either we have a point y*, , Yq < ^ > where m»(y^) = 0 (and 

hence where the entire tangent line is above the height v since 

in(y^) > v) or m*(y) <0 for yQ < y 1 1; since m(i) > v, the tangent 

line at l will do in this case. 

We now define an auxiliary game over X and a two dimensional 
simplex Z via the usual linear extension ana M(x,z^) = Kyy(x,y^), 

M(x,Z 2 ) == - V, M(x,z^) = V2 - V, where v^ and are, for fixed x, 

the heights at 0 and 1, of the tangent line to the curve K(x,y) at 
y^ . We have chosen y, so that / M(x,y)dFQ(x) ^ 0 , and thus by Lemma 2 

we have an F* = for which / M(x,z)dP*(x) > 0. But 

Xi ' Xg 

for h(y) = / K(x,y)dP*(x) we have the heights at 0 and l of the 
tangent line to the curve h(y) at y^ > v; since h* * * > 0, the convex 
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portion of the curve occurs over an Interval [a,l] which includes 
since h*»(y^) > o. The convex portion clearly lies above the tangent line 
at y^, and since the concave portion of the curve, which occurs over the 
interval [o,a], has both endpoints above the height v, h(y) > v for 
all y, and P* is optimal in the original game. 

Case (e). This can be analyzed similarly to case (d). Since 
these five cases extiaust all the possibilities the proof of Theorem 1 is 
now complete. 

^ 4. OPTIMAL STRATEGIES FOR PLAYER I WITH n = 4 

Throughout this section we assiome that (x,y) > 0. The 

following result is demonstrated. 

THEOREM 2. If K possesses continuous fourth 
partial derivatives and ^ ^ o < x, 

y < 1, then player I has an optimal strategy with at 
most 4 points of Increase. 

The method of proof of this theorem is analogous to that enployed 
in Theorem 1 . Again, without restricting generality we may assume that 
Kyyyy(x,y) ^ 0. Purthormore an optimal strategy for player II Involves at 
most ^ “ 2 points. The various possible minimizing strategies are there¬ 
fore of the form (a) <*1 + (i_d.)l , with 0 < y < y. < 1, 

(b) dLIo + ( 1 -<^)I^ with 0 <y < 1 , (c) ci .1 + ( 1 -ol)I with 

^ o ^ ^o 

0 <yo<l, (d) OLI^ + (i-t^)I^, (e) ly with 0 <y^<l, (f) I^, 

and (g) I^ . We have omitted one additional possible strategy with total 
weight 2 ; namely + ^ 31 ^ + (l-d-/3)I^, where 0 < y^ < 1 . This form 

for an optimal strategy is not possible. 

(B) Indeed, let us suppose that player II has an optimal strategy 
of the above form. Let P^(x) be optimal for player I, then 
m(y) = /q K(x,y)dPQ(x) has the following properties; m( 0 ) = v, m( 1 ) = v, 
m(yo) *= V, m»(yQ) = 0 and m(y) > v for 0 < y < 1 . It follows then that 
m is convex at while concave somewhere between 0 and y^ and some¬ 

where between y^ and i. This contradicts the fact that m'‘(y) is 
convex which is required by m*'»*(y) > 0 . 

We shall frequently use this general fact that the yield m(y) 
of any strategy P (l.e., m(y) = K(x,y)dP(x)) cannot be concave in two 
portions and convex in between. 

The proof of Theorem 2 will consist in verifying for each of the 
possible forms of the optimal strategies for player II that an optimal 
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strategy for player I of the desired type exists. 

Case (a). Let the minimiz ing player have an optimal solution of 
the form G^ - *1^ + (l-«t)Xy . where 0 < y^ < y, < 1 . Let the set X 

consist of all x for which K(x,y)dGQ(y) - v. We construct now the 
following auxiliary game M(x,z) defined for x In X and z In Z 
where Z Is a 3 dimensional simplex spanned hy the points , z^, and 
z^. For X In X, set M(x,z.,) - v.,-v, where v., Is the tangent line 
to the curve K(x,y) at y^ evaluated at o, MCxyZg) *= Vg-v, where Vg 
Is the tangent line to the curve K(x,y) at y^ evaluated at 1, and 
M(x,z^) and M(x,Zj^) are defined similarly In terms of curve K(x,y) at 
the point y., . The function M(x,z) Is defined over Z by linear ex¬ 
tension. The kernel M(x,z) satisfies all the conditions of Lemma 2. 
Furthermore, if Fq(x) Is optimal for player I and the game K(x,y), then 
M(x,z)(3Fq(x) = 0. Lemma 2 provides an optimal strategy F*(x) with at 
most 4 points In its spectmmi such that M(x,z)dP*(x) > o. Put 

h(y) = Iq K(x,y)dF*(x). The optimal nature of P*(x) for the game M(x,z) 
Inplles that the tangent lines to h(y) at y^ and y^ lie everywhere 
above the height v. Consequently, h(yQ) > v and h(y^) > v. Hence, 
h(y)dGQ(y) > v. But since every x involved in F*(x) Is included 
in X, we conclude that clF*(x) K(x,y)dGQ(y) = v. Thus, 

h(y^) = h(y^) - V. Therefore also, h*(yQ) = h»(y^) - 0. In view of the 
remark (B), we deduce that h(y) > v throughout the unit interval. 

Case (b). For this case we construct the auxiliary game over X 
and Z as follows; The values of M(x,z.,) and M(x,Z 2 ) are exactly as 
in case (a). Put M(x,Zj) = K(x,o) - v and M(x,Z|^) = + Ky(x,o) and 
M(x,z) for z in Z is defined by linear extension. The set X consists 
of all x for which / K(x,y)dGQ(y) = v where 

By Lemma 2 the game M(x,z) with x in X and z in Z has an optimal 

strategy F*(x) with at most 4 points of Increase such that 

M(x,z)dP*(x) > 0. This gives for h(y) - K(x,y)dF*(x) that 
h(o) > V and hCy^) > v. It can be deduced in a similar manner to case (a) 
that "wo) = hCy^) = v and * o while h»(o) > o. With the aid of 

remark (B) we conclude easily that h(y) > v for o < y < 1 . 

Case (c). If the minimizing optimal strategy has the form 


G - dl, + (l-oL)i , then an argument similar to that employed in case (b) 
o 1 yQ 

applies here to furnish the desired kind of optimal strategy for player I. 


Case (d). Let G^Cy) = AI^ + (l-d)I^ and let X consist of 
all x in the unit Interval for which / K(x,y)dGQ(x) * v. Put for x in 


X M(x,z,) - K(x,0) - v, M(x,Z 2 ) - Ky(x,0), M(x,z^) - K(x,1) - v and 
M(x,Zi^) « -Ky(x,l) with a linear extension. Again, one can find an optimal 
strategy P*(x) involving at most 4 points for which / M(x,z)dP*(x) > 0. 
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It follows easily for* h(y) « K(x,y)clF*(x) that h(o) > v, h( l) > v, 
h*{0) ^ 0 and h'(l) ^ o. Enploying the definition of X yields that 
h(0) = h(l) = V. On account of remark (B) it follows that h(y) > v for 
y in the unit Interval. 

Case (e). The form of the minimizing solution is I with 

^o 

0 < yQ < 1 • We subdivide this case into four subcases. The analysis of 
case (e) is as follows; 

Case (e^) treats the situation where there exists a solution 
F(x) whose yield m(y) is convex for all 0 < y < l . The other alterna¬ 
tive is that m(y) is concave somewhere in the unit interval. For def¬ 
initeness, we take m(y) to be concave to the left of y^ and consider 
all resulting possibilities. An entirely analagous investigation applies 
if m(y) is concave in a portion to the right of y^. Under the given 
supposition in view of remark (B) and the fact that m(y) is always convex 
at y^, we deduce that m(y) is convex for 1 > y > y^^- 

Three possibilities arise in this circumstance that m(y) is 
concave in a portion to the left of y^. 

Case (eg) examines the situation where m(y) is concave at 0. 

Case (e^) treats the circumstance where there exists a 
0 < yi < yQ for which m**(y^) > o and ra’(y^) = o and case (e^^) con¬ 
siders the possibility that m*»(0) > 0 while m*(0) > 0. 

(e^). Suppose there exists an optimal Fq(x) for which 
ni(y) = /q K(x,y)dFQ(x) is convex for all y in the unit interval. Let X 
be composed of all x where K(x,yQ) = v. We now define a new game M(x,z) 
over X x Z as follows. For x in X, set M(x,zp = v^ - v, where v^ 

is the value of the tangent line to the curve K(x,y) at y^ evaluated 

at 0, and M(x,Z 2 ) = Vg - v, where Vg is the value of the tangent line 

to the curve K(x,y) at y^ evaluated at l . Finally for the segment 

[z^,Zi^] which we choose to be the unit interval [0,1 ], we define 
M(x,z) = Kyy(x,z). Since the fourth derivative Kyyyy > get that 

M(x,z) is convex on the segment [z^,Zi^] for each x. The function 
M(x,z) is defined on the segment [z^,z^] and at the vertices z^ and 
Zg. We first extend M(x,z) to the face L spanned by Zg, z^ and Z]^. 
Every point p of L not on is a convex combination of a point 

z of the segment [z^,Zi^] and Zg. Explicitly p = c^z + (1 -ct.)Zg. Put 
M(x,p) « d.M(x,z) + (1 - c*)m(x,Z 2 ) . Thus M is defined on L. In an 
analagous way M can now be extended to the full simplex Z, and is 
easily seen to be convex. It now obviously satisfies the requirements of 
Lemma 2. Furthermore, the natare of m(y) implies that 

M(x,z)dFQ(x) >0. Cn account of Lemma 2, we can select an optimal 
strategy F*(x) which involves at most 4 points in its spectrum for which 
M(x,z)dF*(x) > 0. Let h(y) = K(x,y)dF*(x). An interpretation of 
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of the auxiliary game introduced yields that h**(y) >0# h'Cy^) ~ 0 and 
Consequently, h(y) > v for 0 < y < l . 

(eg). Suppose there exists an optimal strategy PQ(y) for which 
in(y) - /q K(x,y)dPQ(x) is concave at o. The set X is chosen as we did 
before for (e^). We construct M(x,z^), M(x,Z 2 ) as before while 
M(x,Zj) = K(x,0) - V and M(x,Zi^) = -Kyy(x,o) with M(x,z) extended 
linearly over Z for each x in X- An optimal strategy using at most 4 
points for the game corresponding to M(x,z) turns out to be an optimal 
strategy also for K(x,y). The details are similar to the preceding cases. 

(e^) . We assume now that there exists an optimal strategy 
for which m(y) = K(x,y)dPQ(x) has the following properties: 
in‘(yQ) = 0, m(yQ) = v, m(y) > v for o < y < 1, there exists a 
0 ^ ^ Vq fo^ which m**(y^) > 0 and m‘(y^) = 0. Let X comprise 

those X for which K(x,yQ) ~ v. Let Z be a 4 dimensional simplex 
spanned by z^ , Zg, z^, Zj^ and z^. Let for x in X M(x,z^) and 
M(x,Zg) be given as before. Also, put M(x,z^) - v^ - v, where v^ is 
the tangent line to the curve K(x,y) at y^ evaluated at o, 

M(x,Z]^) V]^ - V, where V|^ is the tangent line to the curve K(x,y) at 

y^ evaluated at 1, and M(x,z^) «Kyy(x,y^). Furthermore M(x,z) is 
extended linearly over Z. It follows easily that M(x,z)dPQ(x) > o. 

We now verify that the optimal strategies for player II for the game with 

payoff M(x,z) cannot possess an Interior pure strategy I . Otherwise, 

o 

M(x,z)dPQ(x) H 0 for it is slnple to show that the value is zero and 
therefore m(y) = / K(x,y)dPQ(x) satisfies m(y) > v throughout and 
in(y^) = V, ra*(y^) == o and m»*(y^) =0 which contradicts the assim^jtlon 
made on m(y). In view of [1] and the corollary to Theorem h of [2], we 
can conclude, since I^ is on the boundary of Z, that there exists an 

optimal strategy P*(x) using at most 4 points. Let 
h(y) = /q K(x,y)dP*(x). It follows that b'Cy^^) = 0, hCy^) = v, the 
tangent line to h(y) at y, lies above v for o < y ^ i and h(y) 
is convex at y,• Now with the aid of remark (B) it is easy to show that 
h(y) > V throughout the unit interval. 

It remains only to consider the case where m(y) = / K(x,y)dPQ(x) 
satisfies the same properties as in (e^) except that y^ = 0. We then 
define M(x,z^) and M(x,Z 2 ) as before while M(x,z^) = K(x,0) - v and 
M(x,Zi^) = Ky(x,0) with X any point in the set X where K(x,yQ) = v. 

A slii?)le analysis with the help of the game M(x,z), shows in this cir¬ 
cumstance the existence of an optimal strategy of the desired kind. 

(e|^). The final case consists of a solution Pq(x) such that 
in(y) = K(x,y)dFQ(x) is convex at y^ and at o in such a way that 
m‘(0) > 0. The auxiliary game used here is the same en 5 )loyed in case (b). 
An optimal strategy P*(x) using at most 4 points exists with 
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h(y) = / K(x,y)dF*(x) such that h'Cy^) = o, hCy^) « v, h(o) > o and 
h*(yo) >0. It follows on account of (A) that h(y) > v In the unit 
Interval. 

Case (f) and Case (g). The arguments for these two cases are 
similar to the preceding. 

The proof of Theorem 2 is now complete in view of the fact that 
we have treated every possibility. It is interesting to note that the 
proof of Theorem 2 Introduced some new techniques in order to exhibit the 
desired strategies. In particular, we enphaslze the proof of case (e). 

In a future paper we Intend to present a generalization of this 
result to the case where x ranges over a compact space and y traverses 

a k dimensional set with the condition K __(x,y) > o replaced by the 
th * y 

requirement that the n term of the Taylor expansion in y should be 
non-negative. Also, the question of uniqueness of the set of optimal 
strategies caji be analyzed. 

^ 5. DIMENSIONAL RELATIONS 

In this section we ainalyze further properties of the optimal 
strategies for the two cases considered in sections 3 and 4. We deal first 
with the case where Kyyy(x,y) > o. Here any optimal minimizing strategy 
must be confined at most to two points, o and y^ or o and 1 , and we 
can therefore speak about the dimension of the set of solutions for the 
minimizing players. The two possible cases are 0 and 1 dimensional 
sets. If the spectrum for the optimal minimizing strategies is restricted 
to one point, then clearly the solution is unique for player II. 

Case (a). Let us suppose that player II has a one dimensional 
set of optimal strategies mixing the pure strategies 0 and y^, with 
0 ^ yQ ^ 1 * There exist at least two optimal strategies of the form 
G = A1 + (1 - ^)I and G' = ^ 

sider the set X of all x for which / K(x,y)dG(y) = J K(x,y)dG*(y) = v. 
Explicitly, we obtain 

A [K(x,0) - v] + (1 - A)[K(x,yQ) - v] = 0 
,^*[K(x,o) - v] + (1 - A*)[K(x,yQ) - v] = o . 

As A», we find that K(x,o) = = v. We now construct the 

auxiliary game where z consists of a one dimensional slirplex spanned by 
z^ and Zg- Put for x in X M(x,z^) = -Ky(x,yQ), iyi(x,Z 2 ) = Ky(x,yQ) 
and let M(x,z) be defined on the remaining points of z by linear ex¬ 
tension. There exists an optimal P* using only two points at most. In 
view of the nature of X it is easily verified that F* is an optimal 
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strategy for the game given by K(x,y) 

Case (b) . We assume that player II has a one dimensional set of 
strategies using only the points 0 and 1 It can be shown as above that 
there exists an optimal maximizing strategy consisting of at most two 
points of increase. 

We have thus demonstrated the following theorem: 

THEOREM 3 . If K satisfies Kyyy(x,y) > 0 and 
player II possesses a one dimensional set of optimal 
strategies then player I can find a solution using at 
most two points of increase. 

In a similar manner we can obtain 

THEOREM 4. If K satisfies ^ ® 

player II possesses a one dimensional set of optimal 
strategies, then pla;/er I can find an optimal strategy 
with at most three points in the spectrum. 

Every case is easily handled but one. Suppose the minimizing 
strategy has a one dimensional set of solutions using and y^ with 

0 < Yq ^ i'l ^ ^ ^ consist of all x where K(x,y^) = K(x,y^) == v. 

An argument as in Theorem 3 shows that these are the only points x which 
need be considerea. We construct the following auxiliary game defined over 
X and Z where Z is a two dimensional simplex. Put M(x,z^) = the 
tangent line to K(x,y) at y^ evaluated at 1 minus the tangent line 
to K(x,y) at y^ evaluated at 1 . M(x,Zj 3 ) = the same as above except 
the evaluation takes place at 0 and M(x,z,) = the tangent line to 

K(x,y) at y^ evaluated at -^=^ 2 — minus v. If P is optimal for the 
game corresponding to K(x,y) then M(x,y)dP(x) = 0 . Thus Lemma 2 
provides an optimal strategy P* using at most 3 points of X with 
/ M(x,y)dP* > 0 . One can easily verify that P* is optimal for K(x,y). 
This completes the proof. 

In the general case where Ky_ y(x,y) > 0 for n partial 
derivatives with respect to y, it seems that if the y player has a 
k-dimensional set of solutions, then the x player can find an optimal 
strategy involving at most n - k points in its spectriom. 

i 6. AN APPLICATION 

We close this note with an application of Theorems l and 2 to a 
class of matrices. Plrst, it is important to note that the conclusions of 
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Theorems l and 2 remain valid when x traverses any compact set and where 
y ranges over the unit interval. We consider now a class of matrices 
(aij) 1 < i < n, 1 < j < m, satisfying the requirement that > 0 

for each i where k is a fixed integer <4. We define Aa^ “ a^ - a^_^ 

for r > 0 with a_^ taken to be zero, and is defined by k succes¬ 

sive applications of the operator A* It is easy to show that if there 
exists a finite sequence of numbers a^ (r *= 0, l, ..., n) which satisfy 
Z^a^ > 0 for each r, then the function f(y) defined as f(^) = 

r = 0, 1, m and extended by linear interpolation between the succes¬ 

sive values of r/m possesses the property that A^f(y) > 0 with the 
difference increment taken to be ~ and enjoys properties similar to func- 
tions for which f' ^(y) >0. Indeed, we sketch the proof by Induction. 
When k “ 1, then the above interpolation yields a monotonic increasing 
function. If k = 2, it is also trivial that the linear interpolation 
produces a convex function. We treat the case k ^ 3- Let b^ =* Aa , 
then Ab^ > 0. Let g(y) denote the Interpolated convex function with 
g(“) = Lj,. Set g(y) =0 for y < o and define f(y) = g(y - ^). 

It easily follows that f(y) - f(y ' = g(y)> f(j) == and f is 

piecewise linear between the points Since g(y) is convex and the 

piecewise linear character in equal lengths of f(y) implies that a con¬ 
vex portion of f(y) cannot be followed by a concave part. This was the 
essential fact that enabled us to carry through Theorem 1 . A similar anal¬ 
ysis applies to the case k = 4, We perform the above extension for every 
row of the matrix and we secure a function K(x,y) with x ranging over 
a finite number of points i = 1 , ..., n and y over the unit Interval. 
The conclusions of Theorem l and ? remain valia for such a piecewise linear 
kernel. Consequently, we can find optimal strategies of the game K(x,y) 
for player I and II using at most k points and k/2 points respectively. 
Due to the linear nature of K(x,y) any point y can be obtained as a 

convex combination of two values < y^ < r + -- with K(x,y_) = AK(x,~) + 

4 in w III (j in 

(1 - A)K(x,r + j). Thus in terms of the original matrix both players I and 
II possess solutions employing at most k rows and k columns. 

THEOREM 5- If is a matrix such that for 

each 1 ^ o for all j with k < 4, then both 

players have solutions using at most k rows and col¬ 
umns respectively. 

Finally, we remark that all the analogous results hold for the 
situations where Ky __y(x,y) < 0, > 0 and ^ 
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NOTES ON GAMES OYER THE SQUARE"^ 

I. Gllcksberg and 0. Gross 

INTRODUCTION 

In attempts to find methods of solving a fairly wide class of 
(2-person, zero-sum) games over the unit square, real success has been at¬ 
tained In only two cases: (l) Games In which the problem Is essentially a 
flnlte-dlmenslonal one, notably those with polynomial or polynomial-like 
payoffs [1], and (2) games having solutions which are absolutely continuous 
(or very nearly so) and can be solved via differential or Integral equa¬ 
tions [2,3]* These latter gaiTies all feature discontinuities In the payoffs 
or their derivatives. Attempts to flno a tractable though wider class than 
that of polynomial games have led, naturally, to investigation of the class 
with rational payoff. 

The object of these notes is to present some slirple examples and 
results which, though of meager intrinsic interest, may serve as some guide 
In future Investigations. In ^ 1, we give a simple consequence, due to one 
of the writers (0. Gross), of Tarski*s decision theory of elementary algebra 
[4], together with an example, to show that rational games do not share with 
polynomial games the property of always having step fionction solutions. In 
^ 2, we give an exanple of a game with rational payoff in which the unique 
optimal strategy for each player Is based on a dense countable set. Prom 
this we conclude that neither of the methods mentioned above is completely 
applicable to the class of rational games. In the remaining section, we 
give explicit constructions to show that even In the class of games with 
payoffs In one may obtain any given pair (f,g) of distributions as 

the unique solution of an element of the class. 

} 1 . ALGEBRAIC GAMES WITH TRANSCENDENTAL VALUES 

Let P be a 2-person zero-sum game for which the pure strategy 
spaces, S^ and S^, and the payoff function M, defined over S^ ^ ^2' 
are definable In Tarski»s system of "elementary algebra" [4]. Suppose, 

•K- 
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also, that P has a value which Is a transcendental number. We can then 
conclude that there Is no optimal strategy for either player consisting of 
a step function (i.e., a distribution in which the probabilities are all 
concentrated on a finite set of points). For suppose the contrary for one 
of the players, say the maximizing one. Then, for some positive Integer m, 
the value of is given by 


V *= max min 

<‘*1, • • • > '*ni> ^ yeSg 

X,. .... Xj„ G S, 


^ 1=1 


where K is the set of all m-tuples , ..., such that > 0 

for 1 “ 1, ..., m, and ^ ^ according to [4], v would 

be algebraically definable, and it is a principal result of [4] that every 
algebraically definable number is algebraic. 

In partlculaj?, our result applies to any game over the square 
with transcendental value, in which M is a continuous rational function 
with Integral coefficients. 

EXAMPLE. Take 


and 

Here, v 
given by 


4 

TT^ 


M(x,y) = 

(1 + 

=« (x |0 < X < 1 } , 

Sg = ty|o < y < 1}. 

and a pair of distribution 

f (x) = arc 
g (y) = ^ arc 


H- y)(l - xy) 

O * 

xjr 


functions yielding this value is 


tan Vx 

°<yl’- 

tan Vy 


Thus, in this game, there is no step function optimal strategy, for It is 
a transcendental number. We mention, as an aside, that one can show by 
slightly more laborious methods, that the above solution is the only one 
for this game. 


i 2. RATIONAL GAMES WITH PATHOLOGICAL UNIQUE SOLUTIONS 


In this section we shall construct a game with rational payoff in 
which the solution is uniquely given by a pair of distribution functions, 
each of which is based on a countable dense set in (o, 1). The following 
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simple facts form the germ of the construction: 

(a) If, for any continuous function N on the unit square, and 
any pair (f,g) of strategies, one forms the function M by means of 


M(x,y) = N(x,y) 


J*N(x,y)df(x) - jN(x,y)dg(y), 


then the game with payoff M has (f,g) as a solution. 

(b) If R Is any rational function on the square, then 


J[R(x.y) - i R((|.(x),y)] d ^ (x)) 

(where [0,1] -■> [0,1] is a polynomial, Its n-th Iterate, and 

Is a function which Is o for x < a and 1 for x > a) Is again a 
rational function; for it Is precisely 


So ^ - 5R(<f^“^’^Xo).y)] =lR(Xo,y) 

Since the series telescopes. 

(c) The polynomial ^{x) = Ux(l - x) will provide us with a 
dense set of Iterates for certain Xq. 

Only (c) requires any proof, and If we set x^ = then 

"'k+l = - Xj^) = 1 - (1 - 2XJ^)^ 


and 


1 - 2X1^^, = 2(1 - 2X1^)" - 1; 

consequently If we set l Uq = cos 2rfe^, then 

Uj^ ■= cos S^{2ir6^), 


Xk- 2 - . 

Clearly then we need only select an x^ for which the nimibers 
k ^ 

( 2 ^ 0 ^) are, modulo l, dense In (o,l). This Is equivalent to the occur¬ 
rence of every finite sequence of 0»s and 1 * s as a segment In the 

Bl Bt 

binary expansion or (l.e.. If = ^ + + ... then any sequence 

of n zero's and one's may be found as for some k); 
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such numbers (ana x^) are dense In (o,i), and there are a continuum 

of them. 

Now let R be a rational function of a single variable. If we 

form 


V^(x,y) - R(xy) - ^ R((|)(x)y) - - R(x(|)(y)) + ^ R((|)(x)(|)(y)) 
where (p(x) = ^x(l - x), then by (b) 

Jy(x,y)a ( ^0 ^ =lR(Xoy) - -J: R(Xo(|)(y)). 

Consequently the game with payoff M defined by 

M(x,y) = y(x,y) - J*r(x,y)ur(x) - Jr(x,y)cig(y), 


, Is a game with 


rational payoff having the pair (f,g) as a solution. 

For definiteness, let us specifically set R(t) = g ' ”— so that 
M has the form 

M(x,y) == 2 + xy “ p ? + 4xy(l-x) " 2 2 + (1 -y) ‘‘‘ ^ 2 + l ^xy(l -x) (l -y) 

11.1 1 1 1 ^ 1 _ 1 _ 

”22 + x^y ^ + ^XQy(l-y) " 2 2 + xy^ ^ 2 + ^xy^Cl-x) 


where we choose x^ and y^ so that their Iterates are dense. This, then. 
Is the example and we need only show (f,g) to be the unique solution. 

Since, in the example, g places positive weight on a aense set 
of points, we must have, for any optimal f, / M(x,y)df*(x) = v for all 
y. Consequently 

j y(x,y)df'(x) - J r(x,y)cif(x) = J j’r(x,y)df'(x)dg(y) + v = c 
or I ytx,y)d(f' - r)(x) = c. But 

Y(x,y) - R(xy) - ^ R((f(x)y) - 1 R(x<t)(y)) + | R((l)(x)(t)(y)) 

= - Xo - ^(x4)(y))"' + |:(<l>(x)(|)(y))'^] 

= - Xo - |(1>(x))"l[y^ - ^(^Xy))*"] 


and thus 
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- (-Vy"" - ■= ° 

for all y, where = / [x"^ - i((t){x) )'^](l(f' - f)(x). Hence, for all 
m and y, 

- ° = So 

so that 

^ „ 1 n+1 n 

= Sn=0 (- 2^ V ' 

for all y, and \ = ^ ^or all n (obviously « O). However, this 
In^Dliea f* = f, for the sequence of functions I 1, 

is closed in C(0,1) (i-e., any continuous function defined on [0,1] 

may be uniformly approximated to within ^ y 0 by a finite linear combina¬ 
tion of these functions). This is most easily seen by noting that for a 
given continuous F on [0,1] there exists a continuous function G 
satisfying P(x) « G(x) - ^ Gi^(x)) given by 

G(x) = Sn"o ( 5 )'" 

Consequently, if £ > 0 be given, one can find coeficlents a^, ..., aj^ 
for which 

lG(x) - < & 0 < X < 1 , 

by the Welerstrass Approximation Theorem, so that 

|G(<|)(x)) - 2^n=0 ^ ^ 

and 

IP(^) - Sn=o V*’" - 

for all X. 

The same arguments show that g is the unique optimal strategy 
for the minimizing player; thus the solution of the game is uniquely given 
by the "pathological" pair (f,g)- 
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i 3. GAMES WITH GIVEN UNIQUE SOLUTIONS 

In this section we shall construct for each strategy pair (f,g)> 
a game having (f,g) as its unique solution. 

Case I. Neither f nor g a step function. 

One need only set 

M(x,y) = - gji) 

where f and are the usioal power Bioments of f and g. For clearly, 

f and g are optimal and v = o for the game with payoff M; moreover if 
f• is any optimal strategy for the first player then 

jM(x,y)df'(x) = ‘ ° 

for y in the spectrum of g (which by assumption is an infinite set) and 
thus for all y, so that f^ f* = f• Similarly g is unique. 

This aijnple construction must be modified if either f or g 
(or both) are step functions. Indeed, we have several cases. 

Case II. f not a step function, g a step function with a step 

interior to (0,1). 

Let 

g = X j=o (’ihy 0 = yo < y, < ... < yj, = 1 , 0 . 

We define the payoff M of o\ir game by 

- TJ (y-yj)"^ 

M(x,y) = Xn=i 2"'^(x'^ - fn)[(y - - gan-i^ ^ 

where x^df(x), = -f ' yi J^^'^^gCy) • Obviously f and g 

are optimal and v = o. Now If f Is optimal for player I then 

-TT(y-yj)-2 

jM(x,y)df(x) = Xn“l®'"<^A ' ' Ssn-I ^ ® ^ ^ ° 

and since /3^ ^ o, 

jM(x,y,)df'(x) - X^'^^^^n " ° 

SO that 

- TT (y-yj)"^ 

X2-“(fA-fn)(y - ® 

is nonnegative and vanishes at y,. But clearly this quantity changes _8l|5n 



GAMES OVER THE SQUARE 


179 


at If any coefficient In the series Is non-zero; hence f* f, and 

f Is the unique optimal strategy for player I. 

-TT(y-yj)-2 

Since / M(x,y)df(x) « e ^ , which vanishes only at the 

points y •, any g* optimal for player II must be based on these points, 

J 

and 


s' Sj=0 lyj- 

Since f Is not a step function we conclude, as In Case I, that 

0 = ■ ^n^^S 2 n-i - Sgn-i^ = jM(x,y)dg'(y), 

hence ggn-i " ^2n-^ n > o, that Is 

(1) i^o- = Xi% 


. 2n-1 


Now if yj 2y^, j - 2, 3, •••, k, this implies = /j, 
j = 0, 2, ..., k, or g' = g; for since the positive numbers 
7^ f ^2 " distinct. If we divide (1) by the 

2n-l power of the largest of these and let n ’—y «», we obtain 

a\ ^3 « 0. Deleting this term and repeating the argument yields 

' Jq ' Jq 

Pi\ . £, = 0, and thus finally = /•, j == o, 2, ..., k. 

J-j Ji j j 

In case y^ =* 2y^ for some j we need only find a (1-1) con¬ 
tinuous mapping C for which /^(y^) - yj 2yj • For, forming the game 
with unique solution (f,g*), g* = ly. payoff M as has been 

^ _i 

done above, we find that the game with payoff M(x,^ (y)) has the unique 

solution (f ,g) . In the following cases we shall assume that y^ ^ 2y^ . 

Case III. Both f and g step functions with a step Interior 

to (0,1). ^ 

In this case we have f ® ** ^j=o 

1 J 


xg < X, < ... < xj^ = 1, 0 = yg < y^ < ... < y^ = 1, 5^ 0 5^ /ff, 


We set 


M(x,y) = ^ 2"^[(x-x,)^^“ - "* Sgn-i ^ 

-TTCy-y.)"^ -TTCx-x.)”^ 

+ e - e ^ 


where 



180 


GLICKSHEEG AND GROSS 


fgn.i “ 82 n_i “ J 

Here, we have 

_TT(y_yj)-2 _-Tr(y-yj)"^ 

I Mdf = e ^ ,1 Mdg = e ^ 

SO that optimal strategies may only be based on the or y- If f* is 

optimal, then 

-^(y-yjO-s 

0 < - fsn-i^f^y-yi^^’^"’ - San-i’ + ® ^ 

and since 0 

0 

Consequently 

-TT(y-y )-2 

0 < S - f2n-i)<y-yi)^'"’ ^ ° ^ 

and as before we conclude f^n-i * ^2n-l * Since we may assume ^ ?x^, 
we conclude f* = f as in Case II. The same argument shows g to be 
unique. 

Case rv. f a step function with step interior to (0,1) and 
g= /Slg + (1 -/9)I, , 0 < ^< 1. 

Here we set 

M(x,y) = 


Again (f,g) is a solution, v = o, and player I must play the points x^^ 
and player II must play (o,l). For any optimal g* the previous argument 
yields (l - ^*)sln i = (i -y3)sln 1 or g' = g. Moreover, if f* is 
optimal, since 0 < ^ < 1 , 

-A)sln 1) = 0 


2"‘^[(x-x, ’ - f?n-l ^^y^ y ■ -yfi)3Lnl) 


+ e 


-S —' -TT(x-xJ ^ 

_ e 1 ^ 


- ^2 (fgn-i ■ ^2n-i ^ ^"8211-1 ^ • 


X 2‘"(t 


2n-l 


1 



and thus 
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Now the first non-vanishing term of the series dominates all other terms 
of the sum in a neighborhood of zero; but by setting 

= Sum- +1^, -L - 2m7r - 

•^m V 

^m 

we find that the first non-vanishing term has the form 

I 

at y^^ and y^^ respectively, so that the whole sum changes sign near zero 

^2n-l ^ ^?n-l ^2n-1 ^ ^2n-l ^ ^ 

is again unique. 

Case V. f not a step function, g = + (1 - , o < ^ < 1 . 

In this case we modify the payoff of the previous case to 

_ 1 

M{x,y) = Xn“^ ' ^)3ln D + e 

where f^^ is the ordinary moment, / x^df{x). Again (f,g) is a solution, 
V = 0 and player II may play only (0,1). Since any optimal g' must 
yield 0 = / M(x,y)dg(y) as in Case I, g is unique as in the preceding 
case, f is the unique optimal strategy for player I by the arguments of 
the preceding case. 

Case VI . f = c^Iq + ( 1 - g = /SIq + ( l - 0 < oL, ^ < l . 

We set 

M(x,y) = - /^x + (2 - oC)y + + (1 - ot - /9)xy - y^. 


Observe that M is strictly convex in x and strictly concave in y. 
Hence any optimal strategy for either player must be based on the points 
0,1 . Consequently any solution ( 0 ^ 1 ^+ (1 - cC )I^, 1q + (l - )I‘i) 

of the game with this payoff must yield a solution ((o(.*,l - oc*), 

(y9*,l - p)) of the finite game with payoff given by the 2x2 matrix 


fmo.o) M(o,i)\ 


f 0 ^ 

I’ V 1 - 


However, it is easily verified that this game has the unique solution 
((dL,1 - oL), (^,1 - ^)) . 

Case VII. f arbitrary, g = Iq. 

Here we let 
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M(x,y) = ^ 2”^(x^ - y 

where Is the ordinary n-th moment of f. Again (f,g) is a solution 

v’2 . 

V = 0, and g is unique since / Mdf - e ^ . Moreover, if f is 

optimal, we conclude as in Case IV that f^ = f^, or f = f. 

Since we may interchange players and the end points 0 and 1, 
all cases have been covered. 
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ON RANDOMIZATION IN STATISTICAL GAMES WITH k TERMINAL ACTIONS’ 

David Blackwell 


i 1 . SUMMARY 


In a two-person zero-sum game in which a player receives partial, 
l.e., statistical, information about his opponent*s strategy after which he 
takes one of k terminal actions, any randomized strategy is equivalent to 

a mixture of a countable number of pure strategies in the proportions 
n-l 




1 

k^ 


n = 1, 2, 


The proof uses the fact that for any k 


non-negative numbers z 


z^ with 


1 there is a partition of 


the set of positive Integers into disjoint sets S 


such that 


nGSj J 


k a. SPECIAL AND GENERAL RANDOMIZATION 


Many zero-sum two-person games, including statistical multi-de¬ 
cision problems with a fixed sampling plan, have the following structure. 
Player I chooses a point ^ from a set Si. A point x is then chosen 
from a space X according to a probability distribution defined on a 

Borel field IB of subsets of X, and x is announced to Player II. 

Player II then chooses one of k terminal actions, which we denote simply 
by the integers l, ..., k and incurs a loss L(aL),x,i), supposed 
^-measurable for fixed co,!. 

Thus, a pure strategy for I is an coGn, a strategy for II 
is a partition d ^ (A^ , ..., of X into k disjoint sets 

A,, ..., A^, A^ G ft where Aj specifies the set of x's for which II 
proposes to take action j. II's loss is then 

R(w,a) = f L(aJ,x, j)dP^j(x) . 

J Aj 

A mixed strategy for II is a probability distribution Q over some Borel 


^The preparation of this paper was sponsored by the Office of Naval 
Research. 
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field 0 of subsets of the set Y of fi-measurable partitions (0. of X. 

II's loss from Q is 

R(a>,Q) = jR(w,a)dQ(a) 

= 2)j=i j'[aj(x,a)L(w,x,j)dP^(x)]dQ(a.). 

where a.(x,a) is the characteristic fiinctlon of the set Aj of the 
partition d- We shall suppose that a-(x,(l) is measurable with respect 
to each measure Pj^xQ, i.e., that Q assigns, for each a definite 

overall probability of taking ternjinal action j- Then 

R(w,Q) = j’L(W,x.j)[ J a_j(x.a)dQ(a)]dP^Cx) 

= Sj=i ^ L(u),x,j)^j(x,Q)dPy(x), 

where <^j(x,Q) = j aj(x,a,)dG(a) Is the probability imder Q of taking 
action j when x is observed. 

Thus any mixed strategy Q determines a set § of fi-measurable, 
non-negative functions [fj(x)) with ^j(x) = 1 for each x such that 

R(w;Q) = R(w,^) = ^ L(w.x, j)^j(x)dP^(x). 

Now any family $ , whether arising from a Q or not, can be considered as 
constituting a mixed strategy, in which the mixing is done after x is 
observed, with action j being chosen with probability fj(x), and the 
expected loss from 5 is the function R(to,5) defined above. The rela¬ 
tion between Q-mlxing, i.e., mixing before x is observed, and S-mlxlng, 
i.e., mixing after x is observed, has been investigated by Wald [?], 

Wald and Wolfowltz [3], and Kuhn [i], who have shown, under various hy¬ 
potheses, that the two kinds of mixing are equivalent. For the special 
case considered here, we ootaln the even more precise result that both are 
equivalent to mixtures of a countable nvunber of pure strategies in the 

V- 1 1 

proportions j and that the pure strategies may be chosen 

Independently of L(u),x,j). We have already seen above that every 
Q-mlxture is equivalent to a 4>-mlxture, with ^j(x) = ^aj.(x,CL)dQ(Q,) 
Independent of L(a 3 ,x,j), so that it suffices to consider #-mlxtTires. 


^Numbers in square brackets refer to the bibliography at the end of this 
paper. 
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{3. THE MAIN THEOREM 
For ^-mixtures, we prove the 


THEOREM. For any $ *= ((|)^, there is a 

sequence ‘'I'nj 

the clriaracterlstlc function of a iff-measurable set and 
wj=i =1 for all n,x, such that 

^n=1 Oj(x) for all j,x, where 

=* that, for all L(co,x,j), 

RCw,^) * J L(<a),x, j)y.(x)aP^(x) 

= 2T J L(to,x, j)V^j(x)dP^(x)) 

where $ is the mixture of the pure strategies 
... in proportions ... 


PROOF. We define $ y" . Inductively as follows: (j). . *= $ 

J-LJ I J J 

$* = max $, J., j, = smallest j with $, j = 1>*> f, j = 1. f, j = 0, j / j, . 

J 1 

If have been defined for 1 < n, define = 'l>j - 

$* = max i|)|.jj, = smanest j with = (|)*, = 1 , = 0 for 

J 7 ^ Since == 1 = ^i'l=l Wj*' sufficient to show 

that (|)j > j = ^ ...» k, which is equivalent to (|)^j > o 


for all 

n, j. We prove (|)^j > 0 

$,j>0 

for all j; 

suppose (|)^j 

Vij ’ 

(b . - 'K .. 

J n^n J 

Since « 

j Jn- 

For* j = Jn> 

$ , . = $* - 
^n+1 J ^n 

V k (|) . = V“ A. = 
-'J=i ’^nj -'n 1 

kA^, so that 


proof. 
be used; 


1 k-i 

The sequence “ k ^“k~^ sequence which can 

it does have the advantage that the only random mechanism required 
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is one which will select one of the integers 1, 2, ..., k with equal 
probabilities l /k; the probability that integer 1 is selected for the 
first time at the nth trial is exactly Moreover, if is any other 

N 

usable sequence, 5^? >^n 1 ^ ^n ^ ^''n 

converges faster than stated we have: 

If jUL^ > 0, ^ ^ ^ every set of k 

non-negative numbers , ..., x^^ with ^ 

series can be split into k disjoint subseries 

whose s-ums are x^ , • • • > respectively, then 

PROOF. We may suppose > >^2 ^ ‘ ‘ ^ smallest 

N N-1 

Integer for which ^n ^ ^ ^ ^ 2 

sider x^ = 1 - (^~) » 2 i = 2, ..., k. Since 

^1 ^ ^ ^1 i 2, the set x^^ cannot be represented, for 

, ..., juLj^ could go only into the subseries for x^ and their sum 
exceeds x^. 


^ Iv. AH EXAMPLE 

We give here an example of a game of the type described above in 
which any mlnimax strategy for II actually requires the mixture of a 
countable number of pure strategies. We choose rb= {0 ^ < 1}, 

X = {0 < X < ^}, P^Cmln (cj,l - co) ] = 1 , k = 2, L(oj,x, 1 ) * 2, 1, or 0 
according as oj Is <, =, or > L(o>,x,2) = ^ ^ or - according 

as <0 is <, =, or > The game is one in which Player II, seeing x, 
knows that I has chosen one of the two strategies u) = x, to = 1 - x, and 
has available two actions, l and 2. The payoff is chosen so that the 
resulting game has value 1 and II must mix l and 2 in proportions x, 
1 - X for X < ^ in order to achieve this value. No mixture of a finite 
number of pure strategies can achieve this result. Formally, any ^-mixture 
for II is specified by <|)(x) = <|)^ (x), since 1 • Any 0 with 

0 < 0 < 1 for all X determines a the characteristic functions 0 

correspond to pure strategies, and finite linear combinations of character¬ 
istic functions correspond to mixtures of a finite number of pure strate¬ 
gies . We have 


R(u5,0) 


20 (OJ) + 


1-2a> 


[1 - 0(a>)], 


1-0(1 -(o) 


1 -CJ 
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according as Is <, =, or > The choice (|)*(x) * x yields 
R(cj,(t)*) = 1 for all CO, and, since R(^,(|)) = l for all the value 

of the game Is 1 . Thus any mlnimax 4) for II must have R(co,$) < 1 for 
all CO. For (o < this yields $ (co) < co; for ^ this yields 

$(1 - CO) > 1 - CO, so that (|)(x). = x for x < Clearly (|)(x) Is not 
]?epresentable as a finite linear combination of characteristic functions, 
since any finite linear combination of characteristic fimctlons assumes 
only a finite number of values. 

To exhibit as 2^^ where “ 2 "^ and 

Is a characteristic function, we choose for the n-th digit In the 

binary representation of x. 
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Part III 


GAMES IN EXTENSIVE POEM 


The core of our Intuitive notion of a game seems to be the suc¬ 
cessive presentation of alternatives to the players with varying degrees of 
information, or to chance devices with fixed probabilities, culminating In 
terminal situations with preassigned payoffs. Von Neumann has applied the 
name "games in extensive form" to his original formalization of this con¬ 
cept in terms of personal and chance moves, patterns of Information, plays 
and their associated payoffs. Through the Introduction of pure strategies 
this natural game apparatus disappears and only payoff functions defined 
over strategy vectors remain. The resulting form of a game, which is an 
ordinary matrix with real entries in the zero-sum two-person case, is 
called the "normalized form." It is peculiarly suited to the proof of 
theorems which hold for all games, while the extensive form serves to 
separate games into characteristic types. Thus, the normalized form has 
been a tool of great theoretical Importance in establishing the existence 
and classification of solutions for all zero-sum two-person games, while 
the only hope of utilizing the individual properties of such games as 
Chess and Poker for their solution lies In their extensive form. 

With one major exception, games in extensive form have been 
neglected in the press of research on games in normalized form. This 
exception is the theorem which states that every zero-simi two-person game 
with perfect information possesses a solution in pure strategies (see 
Theory of Games and Economic Behavior, p. 112, and for historical Interest 
a paper of E. Zermelo listed in the Bibliography at the end of this Study) . 
This perfect-information theorem still retains its topical importance 
(Papers 11, 12 and 13 all deal, in part, with its extensions and ramifica¬ 
tions) and also points the way to the role of extensive games in analyzing 
the effects of varying the patterns of Information. In PAPER 11, 

H. W. Kuhn Introduces a new formalization of extensive games with precisely 
this object in mind. His is essentially a geometric model, mirroring the 
successive presentation of alternatives by the branching of a topological 
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tree and reproducing the patterns of Information as partitions of the 
vertices of the tree. With this scheme, he extends the theorem cited above 
to general n-person games, proving that every such game with perfect 
Information has a Nash equilibrium point In pure strategies. In addition, 
another problem of Information Is treated, that of the efficacy of behavior 
strategies. A "behavior strategy” can be viewed as a local randomization 
on the occasion of a choice rather than the total randomization of pure 
strategies made before a play by means of a mixed strategy. Kuhn shows 
that, when "perfect recall" prevails, behavior strategies can be used with 
the same effect on the payoff as mixed strategies. Thus, games such as 
Poker can be legitimately solved by means of behavior strategies — with 
evident computational advantages. 

Using the same geometric model, N. Dalkey considers In PAPER 12 
the effect on the normalized form of a game of varying the information 
partitions. In a game without perfect Information the rules do not inform 
a player of the precise nature of the situation that prevails when he Is 
called upon to make a choice. Instead, they Inform him that the situation 
is one of several possible ones. By an "Inflation" Dalkey narrows the 
number of possibilities. Increasing the accuracy of the information, and 
Incidentally, the number of pure strategies. The only restriction on the 
Inflation Is that the resulting Information be no more precise than the 
Information given by the rules, combined with whatever knowledge of the 
situation the player can gain throu^ the use of a pure strategy (In 
general, the choices dictated by his strategy may prevent many situations 
from arising!). The result of the successive application of this process 
until no further Inflation is possible Is called the "complete Inflation" 
of a game. Dalkey shows that two games which differ only In Information 
have the same normalized form (up to repetition of strategies) if and only 
If they have Identical complete Inflations. He also finds the necessary 
condition for the validity of the perfect-Information theorem — namely, 
that the conplete Inflation of the game In question permits each player to 
know everything his opponents knew and did, previous to his own choice. 

Since the known proofs of the perfect-information theorem are 
based firmly on the flnlteness of the games Involved, It Is appropriate to 
ask If the result carries over to the infinite case. D. Gale and 
P. M. Stewart answer this question negatively In PAPER 15- Precisely, they 
exhibit an Infinite game with perfect Information that possesses no solu¬ 
tion In pure strategies. Positive results are obtained by observing that 
the set of plays of a game possesses a natural topology. The authors then 
consider "wln-lose" games, that Is, games In which player I wins a constant 
amount on a subset of the plays and loses the same amount on the 

conplement. If Sj Is open or closed In the natural topology of the plays, 
or In any finite Intersection of open and closed sets, then the game (with 
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perfect information) has a solution In pure strategies. A number of other, 
more detailed, results are obtained and several open problems are proposed. 

PAPER 14 by G- L. Thompson continues the study of behavior 
strategies In an arbitrary game. He introduces the notion of a "signaling 
strategy," which Is a pure strategy cut down to the Information sets on 
which the player Is required by the rules to forget something that he knew 
or did. Thompson shows that a combination of signaling strategies and 
associated behavior strategies suffices to produce any payoff attainable by 
mixed strategies and hence to provide a means of solution. In PAPER 15 he 
applies these conc^ts to the solution of a model of Bridge, considered as 
a two-person game. The model has the usual four players and four suits, 
but just two cards (ace axid king) In each suit. There Is no bidding, so 
only the playing characteristics of Bridge remain. To achieve the mlnlmax 
value in no trump It Is necessary for East-West, South being the declarer, 
to use privately randomized signaling with respect to West*s Initial lead 
from a pair of kings. If one considers such private signaling as contrary 
to Hoyle, It would seem necessary to regard Bridge as a four-person game 
with enforced coalitions or else as a two-person game with announcements of 
pure signaling strategies Included as preliminary moves in the extensive 
form. 

In PAPER 16 J. W. Milnor analyzes a situation which appears in 
many board games. Including Chess and the Japanese game Go. In these games 
one can measure the "incentive" to move at any particular configuration by 
Imagining the possibility of passing Instead. Also, In the end play of such 
games (particularly Go), the entire game may become a "sum" of essentially 
independent games, so that the problem confronting a player Is not only how 
to move but in which game. Milnor shows that the "sum" Is an axiomatic 
group operation and that the "Incentive" gives a natural metric for the 
group. 


H. W. K. 
A. W. T. 




EXTENSIVE GAMES AND THE PROBLEM OP INFORMATION 


H. W. Kuhn’ 


In the mathematical theory of games of strategy as described by 
2 

von Neumann and Morgens tern, the development is seen to proceed in two 
major steps: (l) the presentation of an all-inclusive formal characteriza¬ 
tion of a general n-person game, (2) the introduction of the concept of pure 
strategy which makes possible a radical simplification of this scheme, re¬ 
placing an arbitrary game by a suitable prototype game. They called these 
two descriptions the extensive and the normalized forms of a game. As 
noted there, the normalized form is better suited to the derivation of 
general theorems (e.g., the main theorem of the zero-sum two-person game), 
while the extensive form exposes the characteristic differences between 
games and the decisive structural features which determine those differences 
Since all games are found in extensive form, while it is practical to 
normalize but a few, it seems desirable to attack the completion of a gen¬ 
eral theory of games in extensive form. 

First of all, this paper presents a new formulation of the ex¬ 
tensive form which, while appearing quite natural intuitively, covers a 
larger class of games than that used by von Neumann. The use of a geometri¬ 
cal model reduces the amount of set theoretical equipment necessary and 
clarifies the delicate problem of Information. After the definition of 
pure strategies. Theorem 1 removes the redundancy found in a direct defini¬ 
tion. Theorems 2 and 3 characterize the properties of a natural decomposi¬ 
tion of many games into a subgame and a number of difference games. They 
represent a generalization of the theorem that every zero-sum two-person 
game with perfect Informiation has a solution in pure strategies. Theorem 4 
presents a positive criterion that a game be solvable in behavior strategies 
a method that presents extreme computational advantages over mixed strate¬ 
gies in many cases. 


^The preparation of this paper was supported by the Office of Naval 
Research. 

^von Neumann, J. and Morgens tern, 0., The Theory of Games and Economic 
Behavior, 2nd ed., Princeton, 19^7- 
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Throughout the paper, passages which serve as motivation, in¬ 
terpretation, or heuristic discussion are placed in brackets, [...]. This 
is done to emphasize the independence of the definitions and proofs of 
these sections. 


j 1 . THE EXTENSIVE FORM OP A GAME 

EEPINITION 1. A game tree K is a finite tree 
with a distinguished vertex 0 which is Imbedded in 
an oriented plane.^ 

[The concept of a game tree is Introduced as a natural geometric 
model of the essential character of a game as a successive presentation of 
alternatives. The distinguished vertex and the imbedding are devices which 
facilitate the arlthmetlzatlon of the notion of strategy. Before proceeding 
to the definition of a game, it is necessary to present some general techni¬ 
cal terms associated with a game tree; it is important to remark that, 
although these terms are taken from common parlance, their meaning is given 
by the definitions.] 

TERMINOLOGY: The alternatives at a vertex X G K are the edges 
e incident at X and lying in components of K which do not contain o 
if we cut K at X. If there are j alternatives at X then they are 
Indexed by the integers 1, ..., j, circling X in the positive sense of 
the orientation. At the vertex 0, the first alternative may be assigned 
arbitrarily. If one circles a vertex X O in the positive sense, the 
first alternative follows the unique edge at X which is not an alternative 
The function thus defined which indexes the alternatives in K will be 
denoted by V; thus, v(e) is the index of the alternative e. Those 
vertices which possess alternatives will be called moves ;^ the remaining 
vertices will be called plays . The name play will also be used for the 
unique unicursal path from O to a play when no confusion results. The 
partition^ of the moves into sets A^, j = 1, 2, ..., where A^ contains 
all of the moves with j alternatives, will be called the alternative 
partition . A temporal order on K is defined by X < Y if X lies on 


^A graphical representation of a game by a tree has been suggested by 
von Neumann, loc. cit ., p. 77; however, he only treats the case of games 
with perfect information. 

^It is Important to make a clear distinction between our "moves” and those 
of von Neumaim. Precisely, a von Neimiann move is the set of all moves of a 
given rank in our sense. 

^In this paper a partition means an exhaustive decomposition into (possibly 
void) disjoint sets. 
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the unlcursal path joining 0 to Y; It Is a partial order. The rank of 
a move Y Is the number of X such that X < Y or, eqiilvalently, the 
number of moves X G Wy 

EEPINITION 2. A general n-person game P Is a 
game tree K with the following specifications: 

( I) A partition of the moves Into n+1 Indexed 
sets Pq, which will be called the player 

partition . The moves In P^ will be called chance 
moves ; the moves In P^ will be called personal moves 
of player 1 for 1=1, ..., n. 

(II) A partition of the moves Into sets U 
which Is a refinement of the player and alternative 
partitions (that Is, each U Is contained In P^ Aj 
for some 1 and j) and such that no U contains two 
moves on the same play. This partition Is called the 
Information partition and Its sets will be called 
Information sets . 

(III) For each U C P^ n Aj, a probability 
distribution on the Integers l, ..., j, which assigns 
positive probability to each. Such Information sets 
are assumed to be one-element sets. 

( IV) An n-tuple of real numbers h(W) = 

(h^ (W), ..., h^(W)) for each play W. The function 
h will be called the pay-off function . 

[How is this formal scheme to be interpreted? That is, how is a 
general n-person game played? To personalize the Interpretation, one may 
imagine a number of people called agents Isolated from each other and each 
In possession of the rules of the game. There is one agent for each In¬ 
formation set and they are grouped into players in a natural manner, an 
agent belonging to the 1^^ player if his information set lies in P^^. 
This seeming plethora of agents Is occasioned by the possibly complicated 
state of information of our players who may be forced by the rules to 
forget facts which they knew earlier In a play.^ 

A play begins at the vertex o. Suppose that it has progressed 
to the move X. If X Is a personal move with j alternatives then the 
agent whose Information set contains X chooses a positive Integer not 
greater than j, knowing only that he Is choosing an alternative at one 


^It has been asserted by von Neumann that Bridge is a two-person game In 
exactly this manner. 
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of the moves in his information set. If X is a chance move, then an 
alternative is chosen in accordance with the probabilities specified by 
(III) for the information set containing X. In this manner, a path with 
initial point 0 is constructed. It is unicursal and, since K is finite, 
leads to a unique play W. At this point, player i is paid the amount 
h^(W) for 1=1, n. The case in which K reduces to the vertex o 

is not excluded. Then P is a no-move game, no one does anything, and the 
payoff is h(o) . 

The price of the intuition gained with the use of a geometric 
model is the introduction of a certain amount of redundancy. Suppose P^ 
and p 2 are two games defined with game trees and K 2 such that: 

(1) K-j and are homeomorphlc. 

( 2 ) The homeomorphlc mapping r of onto K 2 preserves 

the distinguished vertex and the specifications (I) - (IV) . 

(3) On each information set, ^ effects a permutation of the 

Indices of the alternatives. (To make this more precise, (3) requires the 
existence of a permutation of the integers 1, ..., j for each infor¬ 
mation set U C Aj such that, if and Vg denote the functions index¬ 
ing the alternatives in and K 2 , V 2 (<r(e)) =I‘-g(V^(e)) for all 

alternatives e at moves in U.) It is clear that in such a case the 
games and Pg should be considered equivalent and that a proper 

definition would define a general n-person game as an equivalence class 
under this equivalence relation. However, this distinction need not be 
emphasized; if care is taken to frame definitions which apply to the 
equivalence class as well as to the representative, one can Ignore it 
entirely in proofs and remark that all of the theorems hold for either 
class or representative. 

Although the majority of the above formalization needs no justi¬ 
fication, ample motivation appearing in the book of von Neumann and 
Morgenstern, several features deserve comment. The first concerns the 
finiteness of the game tree. Since the rules of most games include a Stop 
Rule which only Insures that every play terminates after a finite number of 
choices it is not completely obvious that this entails that the game tree 
be finite. To demonstrate this, following Konig,^ we will assume that 
there are an Infinite number of possible plays and then contradict the Stop 
Rule by constructing a iinicursal path starting at 0 and containing an 
infinite number of edges. Since the choice at 0 is made from a finite 
set of alternatives, there must be an infinite number of plays with the 
same first edge e^ . We proceed by induction; assume that edges 

, ..., e^ have been chosen such that e^ .. .e^ is the beginning segment 


"^Konlg, D., Uber elne Schlussweise aus dem Endlichen ins Unendliche, Acta 
Szeged 2 (1927), PP* 121 - 130 . 
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of an Infinite number of plays. Then, since the next choice is made from a 
finite set, an infinite subset of these plays must continue with the same 
edge, say e^^^. This completes the proof. 

A more crucial question is that of formalizing the state of 
information of a player at the occasion of a decision, l.e., at a move. If 
one examines the information given to a player by von Neumann's "patterns 
of information" it is found to consist of several parts. First of all, he 
is told that it is his move and is told the number of alternatives. In our 
terminology, this says that the move lies in r\ Aj for some fixed i 
and j. Secondly, he is told that the move lies on one of a certain set of 
plays and has been preceded by a fixed number of choices. From this he can 
deduce that his move lies in a set of moves which all have the same rank. 

It is this set of moves which forms a U in the information partition; 
however, we have weakened the requirement that all moves in U have the 
same rank to the condition that no U contains two moves on the same 
play.] 

i 2. COMPARISON TrfITH THE FORMULATION OF VON NEUMANN 

[The object of this section is to clarify the relation between 
our "general n-person game" and a "von Ne-umann n-person game." Incidental¬ 
ly, it will be shown that the formulation given above is more general than 
von Ne-umann's but this is of minor importance beside the major purpose of 
throwing light on the points of agreement. The best way to do this seems 
to be to describe the method of transition from one extensive description 
to the other. Accordingly, we commence by deriving a "general n-person 
game" from a "von Neumann n-person game." 

Take as vertices of K the non-void subsets of the parti¬ 
tions K= 1 , ..., v+ 1 . A vertex A^^ is joined to a vertex 

by an edge if A^^^ ^ ^ some C,^. Remark that A^ has j 

alternatives if it is contained in a which contains j sets and 

iV 

that the moves on K are the vertices A^^, K = i, ..., V, while the plays 
are the vertices A^^^ . The player partition of the moves is defined by 
Pi_ = (A„|A„ C some B^(k)) for k = o, i, ..., n. The information parti- 
tlon of the moves is defined by U = [A lA^ C D^} with one U defined for 
each (k), K = 1 , ..., V and k = 1 , ..., n; the chance moves 

l\ K 

Aw C B^(0) form one-element sets in the information partition. For each 
U C P^ n A^., that is, for each A^ C B„(o), where A^ contains j sets 
of the probability assigned to the alternative corresponding 

to A^, r\ is p (C ) . Finally, the functions h^, are defined on the 

IV IN K K ^ 


o 

For the comparison, the notation of von Neumann, loc . cit .. pp. 73-75, is 
followed. 
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playa by for all plays and k=1, .... n. 

The Imbedding has been left to the last, as it may be, since it 
is Independent of the other specifications. Imbed 0 arbitrarily. 

Suppose the imbedding has progressed as far as the moves We imbed the 

alternatives at all of the of a fixed U in the same order in the 

orientation. This is possible since each of these has the same number of 
alternatives (the number of contained in the fixed set which 

defines U) . 

There are two restrictive conditions which are fulfilled on the 
general n-person game thus obtained. 

(A) All plays contain the same number of moves V. 

(B) All moves in a fixed information set U (defined by 
have the same rank (k) • 

Condition (A) is trivial and can be fulfilled in all of om* games 
by filling out short plays with "dummy" chance moves with one alternative. 
Condition (B) is not trivial and will be discussed after the derivation of 
a "von Neumann n-person game" from a "general n-person game" which 
satisfies conditions (A) and (B) . 


(10:A:a) 
(10:A:b) 
(10:A:c) 


(10:A;d) 


(lO:A:e) 


(lO:A:f) 


(10:A:g) 


The number v is the number given by condition (A) . 

The finite set Si is the set of plays in K. 

For every i = 1, .. -, n: The function ^j^(W) = hj|^(W) 
for W G Jl. 

For every r = 1, ..., V: The partition CL^ in XL 

contains one set A^ for each move X of rank r which is 
defined by A^ = {W|W > X). The partition consists of 

the one-element sets (W) . 

For every r = 1, ..., V: The partition in it' 

contains one set B^(i) for each i = 0, l, ..., n which is 
defined by B^(i) = (W|W > X where X is of rank r and 

X G . 

For every r = 1, ..., V and every i = O, l, ..., n: 

The partition C^(i) in B^(i) contains one set C^ for each 

alternative e at an information set U C which is of 
rank r. It is defined by C^ = (W|W follows some X G U by 
the alternative e}. 

For every r = 1, ..., V and every i = 1, ..., n; The 
partition in B^(i) contains one set for each 

U C Pj^ which contains only moves of rank r. It is defined 
by Dp = (WlW > X G U). 

For every r = 1, ..., V and every Cp G Cp(o): The 
niunber Pp(Cp) is the probability assigned to the alternative 
e by specification (III). 


(10:A:h) 
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The proofs that the games thus derived actually satisfy the 
requirements placed on them (that Is, by Definitions 1 and 2 In the first 
case and by (10:1;a) - (10:1:j) In the second) are omitted. If they are 
not always Immediate, they are all stral^t-forward and easily obtained. 

The Important question Is: What happens If we derive a general n-person 
game from a von Neumann game again? The answer Is quite obvious from the 
above, namely, the set XI has been reduced to Include only those plays 
which are allowed by the rules of the game. More precisely, XL has been 
reduced so that (1) all partitions of a set are such that the union of the 
elements of the partition Is exactly the set and (2) plays it G G dj^(o) 

such that p (C ) = 0 have been dropped. The discussion may be summarized 

K K 

by: 

THEOREM OP CATEGORIZATION: The von Neumann games, 
excluding Illegal or Impossible plays, are the general 
n-person games In which a player * s Information at the 
occasion of a decision Includes the number of choices 
preceding that decision. 

Q 

The following diagram concludes this section with an example^ of 
a general n-person game In which a player is not informed of the number of 
choices preceding his move. The dotted lines enclose Information sets.] 



j 3. PURE AND MIXED STRATEGIES 

DEFINITION 3- Let = (UlU C . A pure 
strategy for player 1 Is a function mapping 


^Thls example, as well as substantial contributions to the Interpretations 
was communicated by L. S. Shapley and J. C. C. McKlnsey. 
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Into the positive Integers such that U C Aj 
implies ir^(U) < j. We will say that ir^ chooses 
the alternative e incident at X G U if 
- v(e). 

[The interpretation of a pure strategy is that it is a plan 
formulated before a play by a strategist for player i who then communi¬ 
cates his choices to the agents of player i. One may do this without 
violating the rules of the game regarding the information possessed by the 
agents by imagining that the strategist writes a book with one page for 
each of player i*s information sets. If an information set has j 
alternatives, its page will contain a positive integer not greater than j 
and is given to the agent who is acting on that information set for player 
1. If his information set appears in a play then he is to choose the 
alternative Indexed by the integer. This interpretation motivates the 
following definitions.] 

Any n-tuple TC = , ..., ir^) of pure strategies for the n 

players defines a probability distribution on the alternatives in each of 

the Information sets of K as follows: 

If e is an alternative at a personal move for player i in 

n if ir^(U) = v(e) 

the information set U: P^(e) 

[0 otherwise. 

If e is an alternative at a chance move: P^(e) is the 
probability assigned to v(e) by (III). This, in turn, defines a 
probability distribution on the plays of K by: P^(W) = 
for all W. 

[The interpretation is immediate; if the n strategists choose 
the pure strategies 'nr^, • • • j then the probability that the play W 

will result is p^(W) . ] 

EEPINITION The expected payoff H^(ir) to 
player 1 for pure strategies ir^, • • • ^ defined 

by H^C-rc) = i = 1. ..., n. 

[Again redundancy is the price of a facile definition of pure 
strategies. Its nature is made clear once it is remarked that a pure 
strategy may make a choice at an early part of a game that makes many later 
moves linposslble and hence renders the choices on those moves irrelevant. 
However, it can be viewed in another manner, namely, the efficacy of a 
strategy is to be measured by the payoff and hence two strategies 

should be considered equivalent if they produce the same payoff against all 
counter-strategies employed by the other players. Leaving the payoff 
function h arbitrary for the moment, this can be restated: two strategies 
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should be considered equivalent If they yield the same probability for 
every play against all counter-strategies employed by the other players. 
The rest of this section shows that these two views of the redmdancy are 
the same and revises the definition of pure strategy accordingly.] 

If IT = (TT^, , ir^) we shall write ir/*r| for 

(ir^, ..., ..., -rr^). 

DEFINITION 5* The pure strategies ir^ and in 
are equivalent . written ir^ = If and only If 

P^(W) = P-Tc/n:!^^^ plays W and all v: con¬ 

taining . 

DEFINITION 6. A personal move X for player 1 
is called possible when playing if there exists a 

play W and ir containing such that P-||-(W) > o 

and X G W. An Information set U for player 1 is 
called relevant when playing if some X G TJ is 

possible when playing ir^. We will denote the set of 
moves which are possible when playing by Poss TT^ 

and the family of information sets which are relevant 
when playing by Rel 


PROPOSITION 1 . A move X for player 1 is 
possible when playing if and only if chooses 

all alternatives on the path from 0 to X which 

are incident at moves of player i. 


PROOF. Let X be possible when playing TT; then there exists 
a play W containing X and IT containing such that P^(W) = 

"^eGW ^ Hence it is clear that IT^ chooses all of the alterna¬ 
tives for player 1 on thus certainly those of player 1 on W^. 

Now assume 'Hi chooses all the alternatives for player i on 
To demonstrate the possibility of X it is necessary to construct a 
play and strategies for the remaining players. Since no information set 
contains two moves on the same play, in constructing the strategies, 
choices on a unlcursal path may be assigned independently. The choices 
for personal moves on are assigned so as to conform to W^. At X 

the choice is made by the construction of a play is continued by 

making choices arbitrarily except when they are specified by . Call the 
resulting play W. The unspecified choices are made arbitrarily and the 
resulting pure strategies are called IT^, ..., -1' •••' 11^. Then, 

since the probabilities of chance alternatives are positive. 
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P^(W) > 0 and X is possible when playing 

COROLLARY. Let the information set U contain 
the first move X for player i on a play W. Then 
U is relevant for all pure strategies for 

player i. 

THEOREM 1 . The pure strategies 'Tr^ and are 

equivalent if and only if they define the same relevant 
information sets and coincide on these sets. 

PROOF. Suppose and U is relevant when playing 

Then there exists a move X G U, a play W, and ic containing IC^ such 
that: 

p (W) > 0 and X t ¥ . 

1C 

Hence ^ ^ relevant for it|. Moreover, by the 

definition ^ of p(W), = Tt[(U) = V(e) where e is the alternative 

at X which lies on W and thus ir^ and 1C| coincide on TJ. 

To show that the condition is sufficient, assxame that a play W 
and 1C containing ir^ are given. If p^(W) = ^ 

ll^(XJ) = v(e) for all alternatives e lying on W and incident at personal 
moves of player 1 in U. All of these moves are possible when playing 
and hence the same conclusion holds for 1C|. But then 

^eGW ’ 

But, interchanging and ic| in this argument, P^(W) = 0 Inplles 

p^(W) = 0. Consequently, TC^ = ir|. 

[The interpretation of a pure strategy as a strategy book can be 
extended to the equivalence classes defined above by leaving blank those 
pages which correspond to irrelevant information sets.-] 

[Even the simplest games, e.g. Matching Pennies, - reveal that a 
player is at a disadvantage if he uses the same pure strategy in each play. 
Instead he should randomize his choices. Two methods of randomization are 
described in this paper. In the first, the player uses a probability 
distribution on his pure strategies, choosing the particular pure strategy 
that he will enploy in a given play of the game according to this distribu¬ 
tion. Following von Neumann, it is called a mixed strategy. The second 
method is studied in Section 5-1 


nSPINITION 7. A mixed strategy for player i, 



EXTENSIVE OANES 


203 


Is a probability distribution on the pure strategies 
for player 1, which assigns probability to 'nr^. 

Any n-tuple ^ of mixed^ strate¬ 

gies for the n players defines a probability distribu¬ 
tion on the plays of K by; 

p^(W) = q,P^ • • • for all W . 

DEFINITION 8. The expected payoff H^(^) to 
player 1 for mixed strategies ^ is 

defined by p^(W)hj^(W) for i = 1, n. 

PROPOSITION 2. For each move X, let c(X) be 
the product of the chance probabilities at alternatives 
on the path from 0 to X. Then 

P„(x) = c(x) X q^f ••• q^ = c(x)Tri=i ( S Oir ) 

^ XGPossir^ n Tti ^ ' xePossTCj^ ’ 

1=1,...,n 

gives the probability that the move X will occur when 
the players play ju.. 

PROOF. This is an immediate consequence of Proposition 1 and 
the interpretation of a mixed strategy. 

DEFINITION 9. A personal move X for player i 
is called possible when playinp; if there exists an 

n-tuple fJL of mixed strategies containing such 

that p„ (X) > 0 . An Information set U for player 1 
is called relevant when playing if some X G TJ is 

possible when playing Again, we shall write 

Poss and Rel fJL^ for the sets of X and U which 
are possible and relevant when playing 

{k. THE DECOMPOSITION OP GAMES 

[It often occurs that the moves of a game which are subsequent to 
a fixed move X form a subgame in a natural manner. They constitute the 
vertices of a game tree with X as first move while the player partition, 
the probabilities at the chance moves, and the payoff on the plays in this 
tree carry over from the original game. This is also true of the informa¬ 
tion partition if, at every move of the original game, the player choosing 
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is informed whether or not his move is in the suhgame. 

If this happens, the moves which do not lie in the subgame also 
form the moves of a game which is determined up to the payoff at the 
vertex X (which is a play in this gamei) . In this section, this de- 
conposltion of a game into a pair of games will be studied to show that 
the equillbrixmi points of the pair determine the equilibrium points of the 
original game.] 


DEFINITION 10. Given a move X in a game P, 
let Kj be the component of K which contains X if 
we delete the unique edge (if any) at X which is not 
an alternative at X. We shall say that P decomposes 
at X into and every information set 

U either is contained in or does not intersect 

The game P^ is called the subgame and is defined 
as follows: 

The game tree is as such it is imbedded in 

the same oriented plane as K and has X as distin¬ 
guished vertex. 

(I^) (II^) The player and information partitions 
of the moves of P^ are the respective partitions of 
the moves of K restricted to K^. The family of in¬ 
formation sets for player 1 will be denoted by 

(III^) For each chance move in P^ the proba¬ 
bility distribution is that specified by (III) in P. 

(IV-j^) The payoff function h^ for P^ is the 
payoff function h restricted to the plays of K^. 

A game Pj)(px) ^ called a difference game , is 
defined for each n-tuple of mixed strategies , in 

P^. Its game tree is K - conpleted by X and has 
0 as its distinguished vertex. The specifications 
(Ij^) - (rVp) are made as above with the additional def¬ 
inition that hp(X) = %(Kx) i to emphasize the de¬ 
pendence of the payoff in shall 

write this payoff as Hp(/*'p,f*^) . The family of infor¬ 
mation sets for player i will be denoted by 

[Corresponding to this natural deconposltlon of P into the 
subgame P^ and the difference game Pj^, there is a natural decomposition 
of the pure strategies for P into pairs of pure strategies for P^ and 
Pp. The main burden of our proofs in this section lies in analyzing the 
effect on the payoff of this decomposition and the analagous splitting of 
mixed strategies for P.] 
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I3EPINITI0N 11 . Let the game P decompose at X. 
Then we shall say that a pixpe strategy for player 

i decomposes at X Into pure strategies and 

foP player 1 in and if 

(a) restriction of ir^ from 

to 3^^ and 

Cb) ^D|i Is the restriction of IT^ from 
to Since is the disjoint union of and 

^^9 we can also compose a pure strategy from pure 

strategies *^x|i ^Dji ^^eh will be denoted by 

"*^1 “ • 

LEMMA. 1. If ir^ decomposes into '*^x|i 
*”l)| i 1 = 1 ^ ^ n, then 

p^(Y) = all Y G Kjy 

and 


P^(Y) = Ptr^(X)%^(Y) for all Y G Kj^ 

where ic = (ir,, • • •, V ' = (^C| i > ‘••'^xln^' 

^ ~ ^""X)| t' • • •' '"1)1 • 


PROOF. The verification is immediate, using the definition of 
,(Y) and the fact that all paths from 0 to a Y in pass through 


DEFINITION 12. Let the game P decompose at X. 
Then we shall say that a mixed strategy jjl^ for 
player i decomposes at X into mixed strategies 
hcii /^Dli for player 1 in P and Pj. if 

(.) Q, - S a, fo/^1 ® vh,™ 

DCir^) denotes the restriction of TT^ from to 

(b) ^/^hen X G Poss 


%ii 


1 ; 


XGPossir^ 



for all , 


where X(ir^) denotes the restriction of ir^ from U. 
to 
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Wien X t Poaa 

q*. = S q~ for all tCyh . 

LEMMA. 2 . Every pair, and of mixed 

atrateglea for player 1 in Pj and is obtained 
from the decomposition of scane in P. 

PROOF. Let denote the pure strategy for P 

obtained by composing and ^Xii- ¥e then set 

X|i^ ^11 ^X|i 

Then (a) and (b) are easily verified once it is remarked that X G Poss 
If and only if X ^ Poss ^jj^* It should be noticed that our composition 
and decomposition of mixed strategies is a consistent extension of the 
original definitions for pure strategies. 

THEOREM 2 . If P decomposes at X then there 
is a mapping of the n-tuples fi of mixed strategies 
for r onto the pairs of n-tuples of mixed 

strategies for P^ and P^ in such a vay that 

(1) H(p.) = 

if corresponds to ^ under the mapping. 

PROOF. The mapping is the dec 0115 ) 0 sltlon of Definition 10 . 

Lemma 2 says that it is a mapping onto all pairs. To prove ( 1 ) we consider 
the members of the equation separately. First, 

(2) H(u.) =X„p (W)h(W) = S p {W)h(W) + p (W)h(¥) . 

^ WGK-I^ !*• WGKjj /*• 

Second, 

(5) P^^(W)hj3(W) = - P^(X)%(^) . 


Noting that. If W 6 K - 
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^D('t^n^ '^‘*1 ’ ’ *^n ^ ^'*D 


(W) 


X Qir • • • <lir % (W) = P. (W) 
-n^^DM ^|n^D 


and hence, comparing ( 2 ) and ( 3 ), we need only show 
(1^) 




However, since 


%(f^) = s p. (W)hy(W) = ^ p„ (W)h(¥) , 

■*■ ■*• WGKj ^ WGKj nc 

to prove (4) It Is sufficient to show 

(5) P^(V) = p^^(X)p^^(¥) for all W G . 


(It should be remarked that this Is the analogue of the second half of 
Lemma 2, stated for mixed strategies, and that our definition of the de- 
conposltlon of mixed strategies has been framed Intentionally to preserve 
this property.) 

Noting that 



where c(X) Is the product of the probabilities of chance alternatives on 
the path from 0 to X (the void product Is taken to be unity) and 


p„ (W) = X 


(W) 


-NnV 


XGPossit, 
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we have 




= C(X)X j Ti=i ( S ) 


XGPosslT. 


-Iv, ■■■ X%<»%<« 

■ 5x •■• v"'™ ■ V” ■ 



(W) 


This completes the proof. 

[The basic consequence of Theorem 2 is that solutions for P can 
be composed from solutions to and if we take equilibrium points 

as our definition of a solution to an n-person game.] 

nSPINITION 13* An n«tuple /^ = > • • •. 

mixed strategies for a game P is called an equilibrium 
point ^ ^ if 


for i = 1, ..., n 

for all where denotes the n-tuple of 

mixed strategies obtained by replacing by 

in jjL. 

THEOREM 3- Let P decompose at X, let be 

an equilibrium point in the sub game P^, and let 
be an equilibrium point in PpC/^) • If [a- is any 
n-tuple of mixed strategies for p which deconposes 
into and jlp, then ^ is an equilibrium point 

for P. 

PROOF. Let fJi^ be any mixed strategy for player i which 
decomposes into f^|l* Then it is clear that decomposes 

into and and 


’°See J. Nash, "Non-cooperative games," Ann. of Math. ^ (1951), 

pp. 286 - 295 . 
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^WgIkj ^ 

“ ^ll^^l/^DIl'hc/^Xli^ “ • 

[The computational consequences of Theorem 3 are cleai^^ it is 
generally easier to solve two small games than one large game. We present 
two applications which derive directly or Indirectly from this remark.] 

(A) THE THEOREM OP ZERMELO - VON NEUMANN. It is well-known that 
a zero-sum two-person game with perfect information always has a saddle- 
point in pure strategies.^ ^ In our formalization, a game with perfect 
Information is one in which all Information sets are one element sets and a 
saddle-point is the zero-sum two-person specialization of the concept of an 
equilibrium point. 

COROLLARY 1 . A general n-person game P with 
perfect Information always has an equilibrium point in 
pure strategies. 

PROOF. The proof is an Induction on the number of moves in P. 

For a game with no moves it is trivially true. For a game with one move it 
is immediate, since if that move is a personal move of player i then he 
should choose the alternative that maximizes his payoff, while if that move 
is a chance move then the theorem is again vacuously satisfied. For a game 
with m moves, since it assumed to have perfect information, it can be 
deconposed into two games with less than m moves. By the induction 
hypothesis, these have pure strategy equilibrium points whose conipositlon 
is again a pure strategy and, by Theorem an equilibrium point for P. 

(B) SIMULTANEOUS GAMES- A class of games, introduced by 

G. Thompson as a natural extension of games with perfect information and 
called simultaneous games , can easily be solved through the use of Theorem 3- 
These are zero-sum two-person games which may be described verbally as 
consisting of a sequence of simultaneous moves by the two players; following 
each such move both are infonned of the choices. Since our formal system 
does not handle simultaneous moves (even Matching Pennies has two successive 


^^E. Zermelo, Uber elne Anwendung der Mengenlehre auf die Theorie des 
Schachspiels, Proc. Fifth Int. Cong. Math., Cambridge (1912), Vol. II, p. 501. 
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moves) we must describe the games as follows: Player 1 has a^^^ ^ 
alternatives at the moves of rank 2k - 1 and Player 2 has alterna¬ 

tives at the moves of rank 2k where k ~ 1 , —, K- Player 1 has perfect 
information at all of his moves, while Player 2 is informed at his moves of 
rank 2k of everything except the choices by Player 1 at the moves of rank 
2k - T. Clearly we can decompose a simultaneous game at any move of 
Player 1 . 


j 5 . BEHAVIOR STRATEGIES 

[In this section, another natural method of randomization is 
investigated. Using this method, a player chooses a probability distribu¬ 
tion on the alternatives in each of his information sets, thus randomizing 
on the occasion of a choice as he knows it. It is explicitly assumed that 
the choices of alternatives at different information sets are made inde¬ 
pendently. Thus it might be reasonable to call them "uncorrelated” or 
"locally randomized” strategies; however, since these are the distributions 
that one would measure in atteii 5 )ting to observe the behavior of a player, 
we have called them behavior strategies .] 

DEFINITION To each U C such that 

U C Aj, a behavior strategy for player i, 
assigns j non-negative numbers b(U,v), V = 

1, ..., j, such that 2b(U,V) = 1. 

Any n-tuple = (p^, ..., p^) of behavior 
strategies for the n players defines a probability 
distribution on the plays of K as follows: 

If e is an alternative at a personal move 
X6UG14^ then P^(e) =b(U,v{e)). 

If e is an alternative at a chance move then 
Pp(e) is the probability assigned to v(e) by (III) . 

Finally, P^(W) = Pp(e) • 

DEFINITION 15- The expected payoff H^(p) to 
player 1 for behavior strategies , •*•' ^n 
defined by H^(p) = P^(W)hj_(W) for 1=1, ..., n. 

[From our interpretation of behavior strategies, it is clear that 
each mixed strategy determines a behavior strategy. The next definition 
establishes this correspondence and the lemma following shows that we can 
achieve every behavior by some mixed strategy.] 

DEFINITION 16 . The behavior of a mixed 
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strategy player 1 is a behavior 

strategy defined ^ by: 

If U G Rel then 

b(U,v) = S Qic / S q_ • 

TCRelU^ UeRelitj^ 

1^{U)=V / 

If U $ Rel then 

b(U,V) = S q_ . 

ir^(U)=»» ^1 

LEMMA 3- Given a behavior strategy for 

player 1, define a mixed strategy ^ ^ 

player 1 by: ^ 

Then is the behavior of 

PROOF. This lemma is a direct consequence of Definition l6 

and (6) . 

[To apnly these notions to a concrete example, consider the 
following game: 


( 6 ) 


A PARTNER GAME. In this zero-sum, two-person 
game, player 1 consists of two agents, called the 
Dealer and Partner, respectively. Two cards, one 
marked "High," the other "Low," are dealt to the 
Dealer and player 2 — the two possible deals occTiring 
with equal probabilities. The agent with the High 
card then receives one dollar from the agent with the 
Low card and has the alternatives of terminating or 
continuing the play. If the play continues, the 
Partner, not knowing the natiire of the deal, can 
instruct the Dealer to change cards with player 2 or 
to hold his card. Again, the holder of the High card 
receives a dollar from the holder of the Low card- 

In our formalization, this game is described by the following 
diagram (remark that the possible plays are labeled with the payoff to 
player 1). 
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= lu^), UL^ = {U^.Uj). % = tUg) • 

For simplicity * 3 sake, we will denote the pure strategies 
for player 1 Py (U,) ,it, (Uj)) and the pure strategies for player 2 

by (iTgdlg))- Then the game matrix of expectations (TT^ .Itg) 


( 1 , 1 ) 


( 1 , 2 ) 


( 2 , 1 ) 


( 2 , 2 ) 


and the "solution" = *^(2,2) “ ‘^(1,2) “ ?(2,1) 2 ’ 
q > = q, \ = ^ Insures player 1 the expectation •J; while player 2 can 

expect to lose no more than On the other hand. If we let x — b(U^,l), 
1 - X = b(U,,2) and y = b(U 3 ,l), 1 - y = b(U 3 , 2 ) be the behavior strate- 
gles for player 1, we have; 


( 1 ) ( 2 ) 


0 

1 

"2 


1 

0 

2 

1 

0 

2 


1 

0 

”2 



Player 1 * s e^qiectatlon against 


^ 1 ) 

( 2 ) 


is ^ 


-|• + ^x + y- xy 




- xy 


Hence the Tmim amount that player 1 can assure himself is 
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max min I -5 + ^ x + y - xy, ^ x - xy) = o . 
0^x51 
Ogygl 


Thus, behavior strategies may do a poorer job than mixed strategies. Re¬ 
mark that the mixed strategy 

Its behavior = (x,y) = ( 5 ( 1 ^,) + ^( 1 , 2 y»q( 1 , 1 ) + ^{ 2 , 1 ))- Hence, If we 


consider the optimal mixed strategy ( 0 ,^,^, 0 ) for player 1 , the associated 
behavior is x = y = ^ and, while the optimal mixed strategy assures 1 the 
amount ^ , even Its associated behavior only assures 1 the amount 0 . 

This discrepancy is due, of course, to the uncorrelated nature of the 
behavior strategy. To obtain positive results on the use of behavior 
strategies we must restrict the nature of the information partition. 


I3EPINITI0N 17 . A game P is said to have perfect 
recall if U G Rel and X G U iniplles X Q Poss 'TT^ 
for all U, X anc ir^^. 

[The reader should verify that this condition is equivalent to 
the assertion that each player is allowed by the rules of the game to 
remember everything he knew at previous moves and all of his choices at 
those moves. This obviates the use of agents; indeed the only games which 
do not have perfect recall are those, such as Bridge, which include the 
description of the agents in their verbal rules.] 

LEMMA 4. Let P be a game with perfect recall 
for i = 1, ..., n. If i has a move on W, let the 
last alternative e for 1 on ¥ be Incident at 
X G U and set T^(W) = [lt^\ U G Rel and 
rr^(XJ) = V(e)); otherwise, T^(W) is the set of all 
ITj^. Finally, let c(W) be the product of the proba¬ 
bilities of the chance alternatives on ¥ or 1 if 
there are none. Then, for all IT and all ¥, 


rc(¥) 


P (¥) = ^ 
IT 


if G T^(¥) 
otherwise . 


for i = 1 , 


n . 


PROOF. It is clear that we need only show that G Tj^(¥) 
implies that chooses all of the alternatives for i on ¥ (if any 

such exist) . But G T^(¥) implies U G Rel and hence, since P 
has perfect recall, X G Poss Therefore, by Proposition I, chooses 

all of the alternatives for i on ¥. 
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LEMMA. 5* Let e be an alternative on a play W 
incident at X G U G and let the next move for 
player i, if any, be Y G V. Fiirther, let 

S = (ir^l U G RellCj^ and 1t^(U) = V(e)) 

and 

T = {lt^| V G Rel 1C^} . 

Then S = T. 

PROOF. Let TT^ G S. Then U G Rel ir^ and hence, since H has 
perfect recall, X G Poss and therefore, by Proposition 1, chooses 

all alternatives for i on the path o to X. But it^(U) = v(e) and 
hence ir^ chooses all alternatives for i on the path O to Y. There¬ 
fore Y G Poss ir^, V G Rel TT^, and G T. 

Let G T. Then V G Rel and hence, since P has perfect 
recall, Y G Poss IT^, and therefore X G Poss and ir^(U) * V(e) . That 
is, G S and the lemma is proved. 

THEOREM 4. Let p be the behavior associated 
with an arbitrary n-tuple of mixed strategies jju in a 
game P (in which all moves possess at least two 
alternatives). Then a necessary and sufficient condi¬ 
tion that 

H^(p) = H^(^) for 1=1, ..., n 

and all jju and for all assignments of the payoff func¬ 
tion h is that P have perfect recall. 

PROOF. Assume that P has perfect recall; then we need only 

show 


P^(W) = P^(^) ^ • 

If there is an alternative e on W belonging to player i which is 
incident at a move in an Irrelevant information set for ja.^ then both 
sides are clearly zero. Hence we may assume that all such information sets 
are relevant for Working with each side separately, first: 

Pjj(W) = P^(e) . 
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Considering those alternatives e on W which belong to 1, their proba¬ 
bilities are given by the fractions of Definition l6. The first denominator 
Is clearly 1 while each numerator Is the denominator of the next fraction 
by Lemma 5* Hence 

where c(W) and the T^(W) are defined as In Lemma 4. On the other hand, 

... 

= S ‘lir ^ 

allir^6T^(W) "n 

by Lemma 4. Comparing the two expressions for p(W), It Is seen that the 
sufficiency Is proved. 

For the necessity. If P does not have perfect recall then there 
must be a pure strategy ITj^ and two moves X and Y In an Information 
set U with X G Poss and Y i Poss Choose a for which Y 

Is shown to lie In Poss 'TC| by the play ¥ and the n-tuple it* • If* one 
sets l^± ^ ^ ^ '^ 1 ^ 

i c(W) . 

However, there Is an alternative e lying on the path from o to Y 
which is chosen by but not by irj_ and thus Is assigned probability ^ 

by the behavior of If we assume 1C|(U) then the behavior of 

|ULj, assigns the probability ^ to the alternative at Y on W. Hence 

P^(W) £ I C(W) 

and the proof is conpleted. 

EXAMPLES. To illustrate the efficacy of behavior strategies, it 
is possible to draw three examples from the literature. It Is mere 
coincidence that they are all variants of Poker; the essential common 
property Is that they all have perfect recall. 

EXAMPLE 1 . von Neumann and Morgens tern give a Poker exan 5 )le^ ^ in 
which the number of pure strategies for each player is 3 , S being the 
number of possible *'hands.'* Hence the dimension of the set of mixed 
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strategies is 5^ - 1 . However, the dimension of the set of behavior 
strategies is 2 S; when S is a large number the difference is con¬ 
siderable . ^ 

EXAMPLE 2 . In the example given by the author,' domination 
arguments reduce the number of pure strategies from 27 to 8 for player 1 
and from 64 to 4 for player 2 . Nevertheless, the computation of solutions 
is still a tedious matter. With behavior strategies the payoff function has 
5 variables for player 1 and 2 variables for player 2 ; moreover it has no 
terms of degree higher than 2 and so the computation of solutions is a mere 
exercise in elementary calculus. 

example 5 . In the Sinrple 3-Person Poker of Nash and Shapley,^ 
domination arguments result in a game in which the three players have, 
respectively, 17, 19, and 31 dimensions of mixed strategies. However, they 
each have 5 dimensions of behavior strategies and this reduction makes 
possible the discovery of the unique equilibrium point for their game. 

H. W. Kuhn 


Princeton University 


^^Kuhn, E-, \ simplified two-person Poker," Annals of Math. Study ^ (1950), 

pp. 97 - 103 . 

’‘*Nash, J. and Shapley, L. S., "A simple three-person poker game," 
of Math. Study 2^ (1950), pp- 105 - 116 . 
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EQUIVALENCE OP INFORMATION PATTERNS 
AND ESSENTIALLY DETERMINATE GAMES ^ 

Norman Dalkey 
INTRODUCTION 

In the first sections (1-5) we examine the equivalence of games 
In extensive form, using the model proposed by Kuhn.^ There are several 
kinds of equivalence that might be explored, depending in part on what one 
considers reasonable methoas of play. We are concerned with equivalence 
with respect to mixed strategies. A quite different notion of equivalence 
would be needed, for example, if the play were limited to behavior strate¬ 
gies . ^ 

The notion of equivalence we evolve is only distantly related to 
the idea of strategic equivalence Introduced by von Neumann and Morgenstern 
([ 5 ], pp- 245 - 248). They are concerned mainly with variations in the 
payoff function which leave a solution invariant; we shall be concerned with 
variations in the structure of a game in extensive form which leave the 
major strategic properties of the game invariant irrespective of the pay¬ 
off function,^ 

A complete treatment of equivalence under variations in the 
structure of a game in extensive form is not given, but only equivalence 
under variations in the pattern of information. Roughly speaking two in¬ 
formation patterns for the same player are equivalent if they differ at a 
given position in the game only in the knowledge which that player has of 
his own previous moves. 

In the later sections, these results are applied to furnish a 
necessary and sufficient condition for a general game to have an equilibrium 
point in pure strategies independently of the particular pay-off function 


^The preparation of this paper was siipported by The RAND Corporation. 

^cf. Kuhn [ 2 ]. 

^The mode of approach is quite similar to that of Krental, Quine, McKLnsey 
[ 1 ], and our results may be considered as an extension to generad. games of 
their results for two-person, zero-sxam games. 
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or of the particular probability distributions assigned to chance moves. 

We call such games essentially determinate , since the question whether or 
not they will have an equilibrium point in pure strategies is completely 
determined by the information pattern alone. 

The condition, which we have labelled effectively perfect infor ¬ 
mation , is that at any move a player know all preceding moves of his 
opponents, and know at least as much as his opponents knew when they made 
those moves. In the special case that there are no chance moves, this 
condition is slirply that the game be equivalent with respect to Information 
to a game of perfect information .^ 

f 2. GAMES IN EXTENSIVE FORM 

We shall follow rather closely the definition of games in ex¬ 
tensive form given by Kuhn, with some minor notational modifications. 

DEFINITION 1 . A general n-person game P in ex¬ 
tensive form is defined by 

(PI) A game tree . K, which is an ordered set of 
positions (x, y, z ...). 

(P2) An information pattern U = 

where each = (U, V, ...) partitions a 
subset of K. 

(P5) An n-conponent, real vector function h = 

(h^(w), h 2 (w), ..., hj^(w)) defined on a 
designated subset W of K. 

(P4) A set function p(V,U), defined on U G 
y=^, 2, ..., m(U), 0 < p(y,U) < 1 . 

When we wish to indicate the dependency of P on these 
entities, we shall write 

P = n(K,T£,h,p) . 

Rather than axiomatize this set of primitives, we shall follow 
Kuhn in giving them a geometrical interpretation. 

K is a finite tree, embedded in an oriented Euclidean plane, with 


^von Neumann Morgenstern first proved that perfect information is a 
sufficient condition for a two-person zero-sum game to have a saddlepoint 
in pure strategies (see [4], Sec. 15)• Kuhn extended this result to equi- 
librlimi points in pure strategies for general games. Shapley [ 5 ] gave a 
necessary and sufficient condition for a saddlqpolnt in pure strategies for 
a restricted class of two-person zero-s-um games which is similar to the 
condition for general games we give below. 
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a distinguished vertex 0. The set ¥ of end points of K are called 
plays 5 the remaining vertices moves . (We shall sometimes call both plays 
and moves by the common name positions .) The unique unlcursal path leading 
from 0 to a play w will also be called a play, and r^resented by w. 

The m positions Immediately succeeding a position x are 
Indexed by positive Integers v = 1, 2, m where m d^ends on x. 

x^ will designate the v'th position Immediately following x. m(x) 
designates the total number of possible choices (alternatives) at x. The 
rank of x In K, l-e., the number of positions which proceed x, will 
be designated by r(x). D(x) (descendants of x) will represent the set 
of all positions that follow x, and D(v,x) the set which follow by the 
V'th alternative. 

The Information pattern % first partitions the moves of K 
Into n+1 exclusive subsets, and then further subdivides each of these 




U = P 


^ are those positions where 


P = (P, 




Is called 


subsets Into Information sets , 
player 1 "has the move 
the player partition . At each x G TJ G 1/^, player 1 Is Informed that he 
Is at one of the positions In U. For each Information set U, the number 
of alternatives Is the same for all positions In U, hence we can write 
m(U), the total number of alternatives available at any position In TJ. 
Information sets are further restricted by the rule that no Information set 
Intersects the same play more than once. 

The set Is reserved for the "chance player," l.e., every 

X G Pq Is a chance move. We allow U G 2^ to contain more than one move; 
this furnishes a convenient way of Identifying the probability distributions 
at different chance moves. 

p(V,U) Is assigned so that for U i p(v,U) = 1 for every V. 
For U G Uq, 0 < p(V,U) < 1, 2^ p(v,U) = 1. Hence for chance moves, 
p(V,U) assigns a probability distribution over the m possibilities. We 
set p(‘y,x) = p(v,U), X G IJ. 

h Is the pay-off function. To each play w It assigns an 
n-tijple of real numbers determining how much each player Is to receive at 
that point. 

We shall call a pair (K,U) a game structure , and corresponding¬ 
ly (K,U) will be called the structure of n(K,U,h,p) . will be called 

the Information pattern for player 1. 


EEFINITION 2. A pure strategy for player 1 Is a 
function TTj^dJ) which maps each U G onto a posi¬ 
tive Integer V < m(U). (We shall sometimes also use 
^ 1 , to denote pure strategies). We define the 
choice at a position x of a strategy as ‘n^(x) = 

"n’^(U) where x G U. 
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It is clear that a game structure (K,3/) com¬ 
pletely determines the set of all possible pure strate¬ 
gies (as well as mixed and behavior strategies) for each 
personal player. 

Note that our definition specifies strategies for 
the chance player as well as for the personal players. 

A chance strategy corresponds to von Neumann and 
Morgenstern * s "umpire's choice." ([4] , p. 81 ). 

•M- 

Let IT = TT^, TTg, ..., designate an 

n+T-ti; 5 )le of strategies, one for each player, and = 

, 1^2 , ..., ir^) an n-tijple of strategies, one for 
each personal player. It is clear that each de¬ 

termines a unique play w, which we will designate by 
wCir*). Let ir*(U) = TT-(U) where U G U^. and ir. is 
contained in fr . We define wCir ) recursively. 

DEFINITION 3- w(Tr*) is the set of positions such 

that 

1 . 0 G W(1T*) 

4- ^ 'M- 

2. X G w(tr ) Implies Xy G w(tr ) where ir (x) = V 
w(Tr*) is the final member of w(Tr*) • In case 
X G w(‘nr*), 'TT* is said to realize x. More generally, 
if is an m-ti; 5 )le of strategies m < n+1, ^ is said 
to realize x if there is some tt* containing ir and 
X G w('Tr*) . 

An immediate consequence of Definition 3 is 

LEMMA 1 . w( 7 r*) = w(/®*) if and only if for every 

X G w(7 r*), Tr*(x) = P*(x), or, equivalently, if and 
only if for every U that intersects w( 7 r*), fr*(U) = 
f*(U). 

Let designate the n-tuple which results when is 

substituted for tTj^ in i.e., if rr* = 

then = (iTq, , ..., , ir^) - 

THEOREM 1 . w(‘nrV/®i) = w(tr*/rj) implies 
w(ir*) = v{ir*/p^) = w(ir*Aj) = w(ir*//®^/Tj) 

PROOF. If no U G Intersects }i(n*/p^), then by Definition 3 
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w(tr*//®j^) Is ind^endent of and hence w(ir*) is independent of 

thus =w(it*). Similarly w(it*/Tj) = w(icV‘t• If* ^ ^ 

intersects w(irV'®i)' hypothesis and Lemma l, ir*//®j^(U) = 

'n:*/Tj(U), i.e., 7rj^(U) = (U) . If no V G intersects v(Tt*/r^), 

then w(ir*/Tj) is independent of Xy If V G 24j intersects w(Tr*/l'j)^ 
then Tr*//<»^(V) =i.e., itj(V) - Tj(V). Since for U G 24^^, 
k ^ 1 , k j, Tt*(U) = V[*/p^{J]) = Tr*/tj(U), the equalities follow by 
Lemma 1 . 

Theorem 1 plays no role in the subsequent development. However, 
it illustrates a form of structural relationship among plays and strategies 
which is lost by a transformation to the normal form of a game. 

In the same way that an n+1-tuple it* of strategies defines a 
single play, an n-tuple of strategies it defines a subtree K(Tr), where 
each branch point is a chance move. The end points of K(ir) are designated 
by W(tc) = {wl there is a Tt^ such that w = w(irQ,ir)}. 

LEMMA 2. W(ir) = W(/») if ana only if w(Tc^,ir) = 
w(irQ,/^) for every ir^. 

PROOF. Sufficiency is immediate. Necessity: Assume W(Tr) = 

WC/') but for some ir^, w(iCQ,tc) ^ w(it^,p). Then there is some such 

that w(irQ,ir) = But then by Lemma 1, for every U G 2^ that 

intersects w(Tq,/>), rQ(U) == and for every other U that intersects 

w(tQ,/°), Tr(U) = /’(U) . Whence v(it^yic) a contradiction. 

DEFINITION h. Let w^ designate the subplay ex¬ 
tending from 0 to X, then for x ^ 0, p(x) = 

TT ry p(-v,y), p(o) = 1 • 

'V -X 

DEFINITION 5- The expected pay-off H(ir) for an 
n-tuple of pure strategies it is defined as 

= iwe¥('TC) ■ 

In case w contains no chance moves, p(w) = 1; otherwise p(w) 
is the product of the probabilities of those alternatives at chance moves 
in w which lead to further members of w. Note that p(w) depends only 
on p(V,U), U G and is independent of the strategies of personal players; 
however, the relation holds 


SwGW(ir) = 1 • 
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4 3 . THE REDCJCED NORMAL FORM OF A GAME 

A list of pure strategies for each personal player of P and a 
specification of the expected pay-off H(ir) for each n-tuple of pure 
strategies is called hy von Neumann and Morgens tern the normal form of P. 
Nhen H(it) is expressed in matrix notation as an n-dimensional array it is 
called the uay-off matrix of p. 

In the transformation of games from extensive to normal form a 
certain kind of redundancy often appears, namely duplications in the pay¬ 
off matrix of rows or columns ("hyper-rows" in the case of n-person games.) 
We shall show below that this redundancy is generally the result of super¬ 
fluous information on the part of one or more players. It is clear that a 
player loses no strategic advantages if dtplications are deleted. This 
motivates the definition of a reduced normal form of a game. We first make 
precise the notion of duplication by defining an equivalence relation for 
strategies. 


EEFINITION 6 . \ = 

H(ir/^i) every ir containing ir^, . 

lemma 3 . = is an equivalence relation (transitive, 

symmetrical and reflexive). 

PROOF. Immediate from the definition. 

Let Sj^, called an equivalence strategy , designate an equivalence 
class of pure strategies for player 1 , and the set of all such 

equivalence classes. The cartesian product S = x S 2 x ... x denotes 
the set of all n-tuples of equivalence strategies. Let s = 

(s^, Sg, •••j Sjj) denote a member of S. Let H(s) = H('nr) where itG s. 

EEFINITION 7 . The reduced normal form of a game 
P is a list of equivalence strategies for each 

personal player 1, and a function H(s) assigning an 
n-tuple of real numbers to each n-tuple of equivalence 
strategies. 

H(s), when expressed as an n-dimensional array, corresponds to a 
pay-off matrix where repititlons of hyper-rows have been deleted. 

4 4. EQUIVALENCE OF GAMES 

Under the presumption that mixed strategies are to be allowed, 
all strategical considerations with respect to a game P are summed up in 
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the reduced normal form. This leads us to consider two different games as 
being equivalent If their reduced normal forms are Identical except for 
possible permutations of the lists of strategies. 

DEFINITION 8. P Is equivalent to P* — In sym¬ 
bols, P = p* — If and only If there Is a one-one 
correspondence between and S| for each 1^0, 

such that under this correspondence H(s) =H*(s'). 

LEMMA k. = is an equivalence relation for games. 

PROOF. Immediate from the definition (since the one-one cor¬ 
respondences and equality of pay-off are equivalence relations). 

i 5 • EQUIVALENCE OF INFORMATION PATTERNS 

Definitions 6 and 8 characterize a kind of equivalence which Is 
not very profound In the sense that It depends on the pay-off functions and 
the particular probability distributions at chance moves. A more revealing 
analysis Is afforded If we deal with equivalences (to be called essential 
equivalences ) that hold Irrespective of the pay-off and probabilities at 
chance moves. 

Consider two game structures (K,?^) > (K’,]^'*) where K = K‘ and 
Uq convenience, we shall say that p Is Identical with p* 

when p(>',U) =p'('V,U') for every U G This Identification seems 

reasonable In light of the fact that for any U $ p(V,U) = 1 for every 
V. With this convention In mind, we define. 

DEFINITION 9. Let (K,U), (K',U') be two game 
structures where K = K*, Is said to 

be essentially equivalent to (K*,?^*) — Li symbols, 

(K,U) - (K*,U*) — If and only if P(K,U,h,p) s 
P(K',^',h,p) for every h and p for which 
P(K,U,h,p), n(K* ,2^* ,h,p) are games. 

LEMMA 5. Is an equivalence relation for game 
structures. 

PROOF. From Definition 9 and Lemma 4. 

THEOREM 2. (K,U) ^ (K,1C*) Implies = P^' for 

every 1. 
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PROOF. The theorem states that the moves assigned to a given 
player by U must be assigned to the corresponding player by U* . The 
theorem holds by assuinption (Definition 9) for P^, Pq* • Suppose Pj^ ^ Pj^ 


for some 1. 

Then there 

is an X 

G 

P. such that X G P'^, 

k ^ 1. We may 

assume 

that there are at 

least two alternatives at x (otherwise x is a 

trivial 

move 

and can be 

eliminated). 

. Let X G U G and 

X G V 6 U'jj. 

Let h 

be as 

follows: 






1) 

hj(w) = 0 

for all 

w 

and for all j i 



2) 

hj^(w) = 0 

for all 

w 

such that x^ $ w and 

Xg t w- 


5) 

h^(w) = 1 

for all 

w 

such that x^ Gw 




h^(w) =-l 

for all 

w 

such that Xg G w. 



With this h it is immediately clear that we can never have > o, 

< 0 where Let and be strategies for player k 

in (K,^*) such that IT^'(V) = 1 and (V) = 2, and both and 

P » realize x. Let T be any n-tuple of strategies that realizes x. 

> 0, hence there is no equivalence strategy in 

P(K,^,h,p) corresponding to the s^* in r(K,U*,h,p) containing 
Theorem 2 assures that there is no loss of generality in 
specializing to the case P = P‘. For the next step, we specialize even 
further, and consider the case of a fixed (but arbitrary) information pat¬ 
tern 2^ - "Wfor all players but one, and examine the effect of varying 
In this uncomplicated case it is convenient to overlook the fact that 
we are dealing with two different game structures, and identify all the 
components, except the information pattern and strategies for the player 1. 
With this convention it becomes meaningful to write, for example, , 

where tt is an n-tuple of strategies originally defined for (K,U) and 
is a strategy for player i in (K* ,240 • This convention has the 
virtue that it saves most of the labor of trivial proofs of one-one cor¬ 
respondences . 

DEFINITION 10. Let (K,U), (K,U0 be two game 
structures where U - 14^ = U' - 2^' • A pure strategy 
for player 1 in (K,26) is said to be essentially 
equivalent to a pure strategy TT^' for player i in 
(K,U0 — in symbols - IT^* — when H(Tr) = H(ir/n:^0 
for every TT containing and every h and p for 

which r(K,U,h,p), r(K,U*,h,p) are games. 

LEMMA 6. Let (K,?4) and (K,240 be as in Defini¬ 
tion 10. Then (K,2t) ^ (K,24*) if and only if for every 
pure strategy for player i in (K,t6) there is a 

strategy for player 1 in (K,24') such that 

ir^ cr and vice versa. 



EQUIVALENCE OP INFORMATION PATTERNS 


225 


PROOF. Sufficiency. If T, = j ^ i, in r(K,1^,h,p) then 
Tj = /j in r(K,16* ,h,p) . For, assume the contrary, then H(ir) = H(lt//®j) 
for every ir containing T^., hut for some tc' containing T^, H(Tf) f 
H(Tr*//°j) . Let iCj_' he the strategy of the i'th player in Tt* . By 
hypothesis there is a such that H(it) = H(‘*t/7r^*) for every 1C con¬ 
taining in particular HCTr’/iTj.) = H(ir* ) . But hy hypothesis 

^ since it‘ contains Tj and Tj = Py But also 
hy hypothesis HCit'/Tr^//^) = ) = H(1C'Aj). Whence HCitO = 

H(ir’//^j), which is a contradiction. Similarly, Tj = /^j in r(K,^*,ti,p) 
Implies Tj = in P(K,W,h,p) . Whence, the equivalence strategies Sj 
in n(K,^,h,p) for j i correspond one-for-one with the equivalence 
strategies S^* in P(K,U*jh,p) . We define a correspondence s^ s^^* hy 
the rule: if G s^ then G s^» where ir^' ^ in . Clearly, if 

then for every whence the correspondence 

is one-one. The equality H(s) = H(s') for this set of correspondences 
follows immediately from the definition of ^ for strategies. 

Necessity. Suppose that there is a in (K,U) such that 

there is no IT^' in (K,U’) for which ^ , Then there is some h 

and p and some ir containing in such that H(lt) ^H(1t/7r^»). This 
violates the assujiption that (K,U) - (£,14* )• 

THEOREM 5. Let (K,16), (K,U') he two game struc¬ 
tures with U - ‘ • The following are 

necessary and sufficient conditions for % - where 

is a strategy for player i in (K,l4 and P^ is 
a strategy for player 1 in (K,^') • 

1 ) W(ir) = WC'JT/P^) for every it containing 

2) w('rr*) = w(irV/Oj^) for every n* containing ir^. 

PROOF. (1) 1) implies in - P^. This is immediate, since if 

w(ir) = W(Tr/P^) then H(Tr) = H(it/Pi) every it. (ii) ir^ P^ implies 

2) . Suppose there is some n* containing ir^ such that w(*n:*) w(it*Ai) 

Then there is no r* such that w(TVPi) "" otherwise, hy Defini¬ 
tion 3, rVPj_(x) = it*(x) for every x G w(it*) and hence, hy Definition 3 

again = ^(n*/p^) = w(ir*) • Let p be arbitrary and set 

h^(w) = 0 for every w ^ w(ic*), and set h^(w(ir*)) = 1. Then > 0 

for some it containing Itj^, whereas H^(ir/p^) = 0. (ill) 2) Implies 1). 
Immediate. 

DEFINITION n. A set of positions B (not neces¬ 
sarily an information set) is said to be realizable by 
ir^ if there is a it* containing ir^ and B inter¬ 
sects w(ic*) . Let U G he an information set and B 
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a subset of U. B Is said to be Isolated in U when, 
for every ir^, if B is realizable by then 

U - B is not realizable by 

LEMMA. 7- Let Uy designate the set of positions 
which follow any move in U by choice of the v*th 
alternative.. B is Isolated in U G ‘Wif and only if 
for every x G B, y G U - B, there is a V G such 
that X G Vy, y G and V 

PROOF. Sufficiency. Consider any and assume realizes 

some X G B and y G U - B. By hypothesis, there is a V G such that 
X G Vy, y G V^, V ^ But if realizes x, then 7r^(V) = V by Def¬ 
inition 3, whereas if realizes y, then 7r^(V) = tj, which contradicts 

the definition of strategy. 

Necessity. Assume that for some x G B, y G U - B, for every 
V G such that x G Vy, y G V,^ then V = Let realize x and 

realize y. We construct a so that for every V G 7/^ such that 

w^ Intersects V, T'^(V) = and for every V G such that w^ 

intersects V, T(V) = • Then realizes both x and y, hence B 

is not isolated in U. 

DEFINITION 12. a) Let (K,U), (K,U') be two 
game structures, where ^ said to be an 

Immediate Inflation of when there is a V G 

and U.|, Ug ^ such that 76^ - [U.j,U 2 } - (V) 

and U.J ,TJ 2 are Isolated in V. 

b) *11^ is an inflation of when there is a 

finite sequence V?, ..., such that 

and Y} Is an immediate inflation of 

V^, j = 1, 2, ..., 1 - 1 . 

c) 11^ is completely inflated when there is no 
such that Vj, is an inflation of U^. 

d) is a complete inflation of if 'U^ is 

an Inflation of and is completely inflated. 

e) u is an Inflation (complete inflation) of 06* 
when ^ is an inflation (complete Inflation) of 

for every i. 

THEOREM 4. Let (K,W), (K,7^*) be two game struc- 
tiires where % - ^ '^1 immedi¬ 

ate inflation of U^*, then (K,U) ^ (K,U*). 
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PROOF. Let V G , Ug G be the sets required by Defini¬ 
tion 12a. Let be any strategy for player i in (K,U*)- Let ir^ 

be the strategy in (K,U) such that for every V V, 

and 7r^(U^) = = \*(V), then TT^*; for, let contain ir^, 

then w(Tt*) = w(it*/n:^*) by Lemma 1, and hence by Theorem 5- 

Consider any 7C^ in (K,tt) • If does not realize V, then there is 

a iTj, •, (U) = \(J3) for U ^ V, and by Lemma 1 \ ^ . If \ 

realizes V, then, since and are Isolated in V, can realize 

either or U 2 , but not both. Let it realize and let 'n:^*{TJ) = 

Ti:^(U) for every U V, and ir^*(U^) = . Since, by Lemma 1, 

does not realize Ug, Whence, the theorem follows by Lemma 6. 

COROLLARY ha.. If (K,U), (K,26') are identical 
game structures exc^t that is an inflation of 

for some 1, then (K,7^) (K,^*) • 

PROOF. Theorem h and Lemma 5- 

COROLLARY 4b. If (K,U), iK,U^) are game struc¬ 
tures such that for every i either %:^ = or 

is an inflation of or is an inflation of 

then (K,26) (K,U*)* 

PROOF. By repeated applications of Corollary 4a. 

THEOREM 5- If (K,U) where = 

W - , and both and 14' are completely in¬ 
flated, then • (Two equivalent completely 

inflated information patterns are Identical.) 

PROOF. Let (K,^), (K,^') be as in the hypothesis, and assume 
-1 ^ * There is no loss of generality in assuming that there is a 

V G and , Ug ^ such that both and Ug intersect V. Con¬ 
sider any strategy in (K,1t*). caiinot realize both V n and 

V n U 2 , for suppose it did; then there is a in (K,U) such that 

^ hence realizes both /l V and Ug ^ V- We define a 

such that for every U* G V^, U* ^ and U* and 

^ Now P^ realizes both n V and Ug /) V, and there 

is no in (K,26') such that P^, since there is some 7t* con¬ 
taining P^ such that w('it*) G Vy and another containing such 

that w(ft*) G V^. Since and are any U G that intersect V, 

each is Isolated in V, which contradicts the assungption that is 

completely Inflated. 
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COROLLARY 5a. An information pattern for 

player 1 has a imlque complete inflation. 

PROOF. Immediate from Theorems k and 5 . 

THEOREM 6. (K,lz) - (K,U*) where U - ^ 

- Hi* only if the coiiplete inflation of 

is identical with the complete inflation of * • 

PROOF. Corollary 5a assures that the unique conplete Inflations 
of and exist. Sufficiency follows from Theorem k, necessity 

from Theorem 5• 


COROLLARY 6a. (K,U) (K,U‘) (where Uq = 

if and only if the complete inflation of Uj is 
Identical with the complete inflation of ' for 
every j. 

PROOF. Theorem 6 and Corollary 4h. 

REMARK. The rather tedious route whereby we arrive at Theorem 6 
and Corollary 6a can be bypassed intuitively by the following heuristic 
discussion. Theorem h, which is not used directly in the proof, indicates 
that inflation is essentially a process of adding to a player*s information 
at a given move, some further knowledge about his own previous moves (where 
thiis additional information tias no implications for previous moves of other 
players.) But if a player is proceeding according to a preformulated pure 
strategy, and has complete information about the structure of the game, 
then at any move where it is his turn to pla^, his strategy will tell him 
what previous moves he has made. Hence, information solely about his own 
previous moves is superfluous. Presimiably, a player's memory of a strategy 
will be equally complete whether it results from a direct choice (pure 
strategy in the strict sense) or from a prior selection of a pure strategy 
by some chance device (mixed strategy). However, it is clear that if the 
player is using behavior strategies — l.e. mixes by some chance selection 
at each of his moves — there is no guarantee that he will remember all 
previous selections. This is true particularly where a player is repre¬ 
sented by a team of persons, each assigned to different information sets. 
For this reason — as is readily verifiable — Theorem 6 does not hold for 
behavior strategies. 
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$ 6. DEFLATION 

So far our emphasis has been on the Inflation of information 
patterns. However, from the practical point of view -- i.e*, from the point 
of view of simplifying games — inflation is not as interesting as its 
converse, deflation . 

To illustrate the order of reduction in size of pay-off matrices 
by deflation, in tlc-tac-toe the first player has roughly pure 

strategies (if we ignore the effect of the stop-rule anc assume that each 
play of the game results in conpletely filling the open squares.) In 
essentially reduced form, the first player has only 10^^^ pure strategies. 
Although this second figure is still ridiculously large, it is clear that a 
tremendous reduction in size of the game is achieved. The pleasant feature 
is that this reduction can be carried out by operations directly on the 
game structure, without first constructing a cosmic sized matrix and then 
eliminating duplications. 

Unfortunately, we cannot assert that every information pattern 
has a unique complete deflation. Consider the game p illustrated below. 
The ellipses represent Information sets for the Indicated players. 



r 

As it stands is Inflated; player 1 at his second move knows 
which first move he made. In fact, is an inflation of * * in 
P* and P’ ' respectively. 
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Both * and ' * are conipietely deflated. It is easy to verify that 
in this case there remains a certain amomt of redundancy in the informa¬ 
tion pattern, in the sense that in both P’ and p' * there are two or 
more strategies that are essentially equivalent. 

if T. ESSENTIALLY DETERMINATE GAMES 

In the preceeding sections we were guided hy a more or less in¬ 
tuitive notion of equivalence, based on the presumption that the normal 
form of a game completely exhausts the strategic possibilities. It would 
be desirable to base our investigations on a set of rules for playing a 
game in a rational fashion. Unfortimately at present the rules for rational 
play can be considered as being in a satisfactory state only for one-person 
and two-person zero-sum games. There is, however, a form of weak solution 
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for general games that has been suggested by Nash [ 5 ] which at least can be 
used for exploring some of the properties of Information patterns^ euid 
which. In the zero-sum two-person case reduces to the acc^ted mini-max 
rule. This Is the notion of equilibrium point. Since we have defined only 
pure strategies above, we limit ourselves to equilibrium points In pure 
strategies. 


DEFINITION 13- A pure strategy n-tuple it Is an 
equilibrium point If and only If for 

every 1 and every 

EEFINITION (K,%) Is said to be essentially 

determinate If P(K,2^,h,p) has an equilibrium point In 
pure strategies for every h and p for which 
r(K,;U,h,p) Is a game. 

LEMMA 8. If (K,2t) ^ (K,U^) then (K,U) Is 
essentially determinate If and only If Is 

essentially determinate. 

PROOF. Immediate from the definitions of ^ and essentially 
determinate. 

Kuhn has shown [2] that a sufficient condition for a game struc¬ 
ture (K,2^3 to be essentially determinate Is that iK,U) have perfect 

R 

Information."^ 


DEFINITION 15- (K,U) Is said to have perfect 

Information If every Information set U Is a unit set. 

It Is clear that no essential modification results If we restrict 
the Information sets In Definition 15 to personal Information sets. 

It Is easy to find examples of games which are essentially de¬ 
terminate and which do not have perfect Information. In fact, any one- 
person game Is essentially determinate Irrespective of the nature of the 
Information pattern (see Lemma 10 below). Hence, perfect Information Is 
not a necessary condition for essential determinateness. 

Let U < V mean there Is a play w which Intersects both U 
and V and the Intersection of U and w proceeds the Intersection of V 


^Strictly speaking, he proved something sll^tly different from this; but 
the step to showing essential determinateness Is trivial, amounting. In 
fact, only to pointing out that both h and p can be chosen arbitrarily. 
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and w. We shall also use the notation occasionally x < U, which means 
there Is a play w containing x that Intersects U, and x preceeds 
the Intersection of U and w. 

DEFINITION 16 . (K,U) Is said to have effectively 

perfect Information when, for every pair of personal 
Information sets TJ, V such that U G V G U^, 

k 1, If TJ < V then V C TJy for some -V. 

Note that the definition says nothing about the relation of In¬ 
formation sets of the same player, nor about the relation of personal In¬ 
formation sets to chance moves. In Intuitive language, a player Is said to 
have effectively perfect Information If at any move where It Is his "turn" 
he "remembers" every previous move of each of his personal opponents and 
knows at least as much as the opponents knew when they made those moves. 

LEMMA. 9• Every one-person game has effectively 
complete recall. 

PROOF. Immediate from the definition. 

LEMMA 10. Every one-person game Is essentially 
determinate. 

PROOF. Since H(7c) (= is a function of only one variable 

over a finite domain, it admits a simple maximum. 

We first show that a game with effectively perfect information 
can be decomposed into a directed set of subgames (ordered by Inclusion), 
each of which can be examined for equilibrium points independently of all 
succeeding subgames. The notion of subgame Involved Is somewhat wider than 
the direct application of Definition 1. 

DEFINITION IT. Let B be a set of positions (not 
necessarily an Information set) and D(B) the set of 
all positions that follow any position in B, i.e. 

D(B) = lyl there is an x G B and y Q D(x)}. Analo¬ 
gously, D('V,B) is the set of positions that follow B 
via the y'th. alternative, i-e. D(V,B) = (y| there Is 
an X G B and y G D(V,x)}. We will write x < U to 
mean x < U or x G U. By the greatest lower bound 
(g.l.b) of B Is meant the x of highest rank that is 
contained in every w that Intersects B. V < B 
means V < B or V Intersects B. 
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A. A set of positions B is said to define a 

subgame when: 

1) For every personal information set V < B, 

B C for some v- 

2) For every personal information set V > B, 

V C D(B) u B. 

B. A pure strategy for a player 1 in Pg is a 
function, , that maps every V G V > B, onto 
an integer v ^ m(V) . We shall also use the expression 

to designate the strategy limited to Pg 

(l.e. is the strategy for player 1 in Pg such 

that = Tr(V), V > B, V G 1^^.) 

0. W('nr®) = {w|w G D(B) and for every personal 
move y > B, y G w Implies y^ G w where 'Tr^(y) = v) 

D. Let p(B) = P(y)- For x > B, Pg(x) = 

My * r. 

E. H(ir^) = X n • 

wGW(tc®) ® 

A rough justification for calling Pg a subgame is the following 
(a more precise justification is found in Lemmas 11-15 below): Defini¬ 
tion 17 A2 states that B isolates a certain portion of K, namely 
B u D(B); no personal Information set overlaps B V D(B) and the rest 

of K. IT A1 assures that one and only one set of choices on all personal 

information sets V < B will realize a position in B l/ D(B) . Thus, given 
a it which realizes B, the selection of a strategy within Pg can be 
made independently of the remaining part of P. Note that (0} defines a 
subgame namely, P itself. 

The significant elements for a subgame Pg, namely strategies 
and expected pay-off, are defined in a manner quite analogous to those for 
a complete game, with g.l.b. B replacing o. We cannot, however, simply 

define a subtree, say I^, which begins at g.l.b. B and let with 

its information pattern define a subgame structure, since in the first 
place, there may be many personal Information sets between g.l.b. B and 
B which overlap Kq and the rest of K, and secondly. Kg may be much 
more extensive than the part of K which is isolated from B onward. 

LEMMA 11 . If B defines a subgame, then for x, 
y G B, g.l.b. {x,y) is a chance move, or B is a 
unit set. 

PROOF. Suppose B is not a unit set and x, y G B. Then g.l.b. 
tx,y} i B. But g.l.b. {x,y} cannot belong to a personal information set 
by Definition 17 Al . Whence g.l.b. (x,y3 is a chance move. 
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LE5MMA. 12. If B defines a subgame P^, then for 
every tr that realizes B, H(ii) *= p(B)H(li:®) + T(1t) 
where T(it) Is Independent of 

PROOF- If “W realizes B, then W(it®) = W(it) n D(B) - Thus 


H(tc) = V p p(w)h(w) + T(ic) where 

T(lt) =V ^ p(w)h(w), whence 

"^'wGWdc) -w(-nr) 

mic) = p(B) T p. p„(w)h(w) + TW 
= p(B) H (It®) + T(«) . 


If w G W('Tt) - W(li®) , then w does not Intersect B, and 
hence, by Definition 17 A2, does not Intersect any personal V > B- Whence 
if IT and ^ are Identical for all personal V J B, T(‘n:) = T(/*) . 


LEMMA 13- is an equilibrium point for P if 
and only if Ti® is an equilibrium point for every Pg 
which is a subgame of P, and for which K(tc) inter¬ 
sects B- 


PROOF- Sufficiency is immediate since P is a subgame of Itself 
Necessity. If ir® is not an equilibrium point of Pg, there is an 1 
and a such that - Let be identical with 

except in Pg, where it is Identical with Then by Lemma 12 

, and it Is not an equilibrium point in P. 

DEFINITION 18 . If U and V are personal in¬ 
formation sets, U is said to be connected with V 
when there is a sequence of personal information sets 
u\ U^, ..., such that U = u\ V = and for 

each 1 there is a w that Intersects and , 

and (I t for any V- 

LEMMA Connected is an equivalence relation. 

PROOF.* a) Transitivity. If U is connected with V and V 

12 1 

is connected with V*, then there is a sequence U , U , ..., U con¬ 
necting U and V and another sequence V^, V^, ..., connecting V 
and V*. The sequence U^, u^, V^, Is a sequence of the 

required sort connecting U and V*. 
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b) Symmetry. Immediate from the definition. 

c) Reflexlvlty. Immediate. 

EEPINITION 19- Denote the set of equivalence 
classes of information sets under connected by C = 

(C^, ...). Let Sc = (x| there is a U G C and 

X G U}, then B(C) = (x|x G S C and there is no 
J ^ l.e., B(C) consists of the minimal 

points of Sc. 

LEMMA 15- If C GC then B(C) defines a subgame. 

PROOF. (1) Let U be any personal information set, U > B(C), 
i.e., there is some w that Intersects U and B(C). Let w intersect 
B(C) in V. If U t Vy for some v, then U G C, and hence every w 
that Intersects U intersects B(C). If U C Vy for some v then again 
every w that intersects U Intersects B(C). 

(2) Let U be any personal information set, U < B(C) . U $ C, 
since B(C) is minimal. There is a w that intersects U and Intersects 
B(C) in say x G V G C, hence V C Uy for some V, otherwise U G C. 

Let V* be any other information set in C. By definition V and V* 
are connected by a sequence v\ V^, ..., V^, V = , V* = V^. We have 

shown that C Uy for some V. Assume that V*^ C Uy. There is a w^ 
that Intersects and , and every w that Intersects V*^ inter¬ 
sects U; hence, w^ intersects U and . Now U ([ for any 

since U < B(C); whence if t Utj for some "y, U G C. Thus 

C Uij for some >j, and >| = V since, by assunptlon, w^ follows the 
'V^th alternative at U. Therefore there is a V such that for every 
V G C, V C Uy. A-fortlori, B{C) C Uy. 

DEFINITION 20. An equivalence class C is said 
to cover an equivalence class C* when B(C) < B(C*) 
and there is no C' such that B(C) < B(C**) < B(C*)- 

LEMMA 16 . If C covers C *, then for every 
U G C*, U > B(C), and for every V G C, if there is a 
w that Intersects V and B(C*), B(C') C Vy for 
some V. 

PROOF. Lemma 1 5 • 

Lemma l6 says in effect that if an equivalence class C proceeds 
another equivalence class C, then B(C*) defines a subgame of . 
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T.TCMMA 17 . Two different equivalence classes can¬ 
not cover the same equivalence class. 

PROOF. Sxjppose C and C both cover C*'. By Lemma 16 every 
w that Intersects B(C'‘) intersects both B(C*) and B(C) . Since B(C) 
and B(C*) are not Identical, we must have either B(C) < B(C*) or 
B(C*) < B(C) . In which case either C or C* does not cover C*'. 

If the first position o of (K,U) is a personal move, the C 
containing O defines the entire game P. If 0 G P^, it is possible 
that no C determines the entire game. In this case it is convenient to 
extend the definition of <5 so that (0) G C. In either case, we designate 
the C containing 0 by . 

THEOREM 6 . C is a tree under the relation covers 
with a distinguished vertex, 0 ^. 

PROOF. Let h- denote the proper ancestral of covers , l.e., 

0 >-C* if and only if there is a sequence 0^,0^, • • • > 0^ such that 
C = , C’ = and 0^^ covers . >- is transitive by definition and 

asymmetrical by Lemma l 6 and the a-cyclicity of the ordering relation 
on K. CqV C for every C 7 ^ 0^. Finally, if C, Cg ^ C, then 

either y- or y- by Lemma 1T • 

LEMMA. 18 . If (K,t^) has effectively perfect in¬ 
formation and C G C then C C for some i. 

PROOF. Let V G C, V G t/-., be any information set in C. Con- 

1 1 2 h 

sider any U G C. U is connected with V by a sequence U , U , ..., U . 

But if G then G since, by assumption, if ^ 

then either C or C U^, and $ C. 

Lemma 18 shows that in the tree ^7, the transition from a set of 

subgames to a covering subgame Involves only one player. 

THEOREM 7 - A necessary and sufficient condition 
that (K,U) "be essentially determinate is that the 
complete inflation of (K,U) have effectively perfect 
information. 

PROOF. Sufficiency. The restriction to the complete Inflation 
of (K,U) is required only for necessity. Hence, assume that (K,24) has 
effectively perfect Information. We show sufficiency by exhibiting, for 
any h and p, a strategy n-tuple ir which is an equilibrium point. By 
a mini Trial C G (5 we mean one for which there is no C' such that C p- C *. 
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It is clear that a minimal C defines a one-person subgame. To simplify 
notation, rather than writing ^^(q) we will write Pq and 

It . 

( 1 ) For each minimal C,^ (= where C C TiE’i) is so chosen 

that 

( 2 ) For any C, ir°(V) = it®'(V) for VeC',Ci-C'. it^dr), 

U G C, is chosen so that 

> Hj^(it®//»^®), C C 14 . 

where /^^(V) = it^*(V) for V e C*, C J-C. To show that any it con¬ 
structed according to the above recursive rule is an equilibrium point, 
let be any strategy for player i, and let , ... be a 

sequence of strategies for player 1 ^ constructed as follows: (a) = 

(b) P^ is Identical with except for the C which we 

shall call C • — of highest rank which intersects K(n/P^h and for which 
ir^(V) for some V G Cj. Note that Cj C U^. (In case there are 
two or more C of equal rank of ^the specified kind, let Cj be any one of 
these.) (c) For V > B(Cj), pj'^^ (V) = (V) . Now by Lemma 12 and the 

definition of ifr 

Since there are only a finite number of C*s which intersect K(1t//’^) and 
the step from P^^ to P^'^^ requires a reduction in rank (or at most a 
finite number of steps before a reduction in rank), the sequence P^^ must 
conclude with a P^ such that K(if//>^^) = K(Tr), whence = 

Hjj^(lC) and therefore Hj^(ic) > Hj^(‘n://\) • 

Necessity. Assume that (K,U*), the complete inflation of 
(K,U) does not have effectively perfect information. Let G U G 
be the personal position of lowest rank for which there is z e ^^(Xq) , 
z e V G U.*, 1 j, V t Uv for any V (if there are several positions of 
the same TnlnlTnfl .1 rank with this property, let x^ be any one of these); 
and let x G V G , k ^ i, be the position of lowest rank in D(Xq) 
such that V t tJy for any V. Since x G for some there is 

a y G V such that y $ • For sin^jlicity we relabel the persons 

and alternatives so that U C , V C Pg, x G D(i,Xq). We distinguish 
three principal cases: 

CASE I. Xq = g.l.b. {x,y). 

Let W = D(x) u D(y) and let m = max [r(xp, r(y^)]. Define 
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h(w) as follows, where z is the highest ranking interseotion of w with 
w^ or Wy: 

(a) w t W 


1. 

Z G P^: 

hj^(w) = 0 for every 

1. 



2. 

z t Pq. 

z < CXq): h^(w) = 

r(z 

p(z 

]- for 

every 

1. 

3. 

Z i Pq, 

z > (Xq): hji^(w) = 

r(z 

p(z 

j- for 

every 

1 1, 


h^(w) = 


otherwise 

h^ (w) 

II 


(b) w G W. 


1 . 1 ^ 1 , 1 2 : 

2. 1=1 or 1 = 


w G D(x^) 

w G ©(Xg) 
w G D(y^) 
w G D(y2) 




2: 


h, (w) 

h2(w) 

m 

m+1 

p(x) 

p(x) 

m+1 

m 

p(x) 

p(x) 

m+1 

m 

pTTT 


m 

m+1 

pTy) 

p(y) 


With h aa defined, no ic la an equilibrium point. There are 
two poaalbllltlea: 


A. K(it) n W = e. 

Let z G U G be the hlgheat ranking Interaectlon of 

K(ir) with w or w^; and let be Identical with IT,, 
^ fill J ^ 

except that /“jj. = V where Zy G w^^ or w . Then 

B. K(lt)/w+e. 

The pay-off to any player is Independent of choices made 
above V; hence there are essentially four cases, depending 
on 1C| (U) and ir 2 (V); these are summed up in the matrices 
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V‘2^^) 

TTi(JK, 

H,(ir) 

1 

2 

NngCv) 

ir, 

H2(tf ) 

1 

2 

1 

in 

m+1 

1 

m+l 

m 

2 

_i 

m+l 

m 

2 

m 

m+l 


For any pair of choices n^iV), there Is a choice by one 

of the players that Increases his pay-off. 

CASE II. Xg + g.l.h. {x,y), U Intersects v^. 

g.l.b. {x,y) 6 Pq, otherwise x^ would not be the mininwi 
position for which effectively perfect Information later falls. Let 
y^ G 2 be the lowest ranking position in w^ such that U Intersects 
and V (t Uy for any V. Because of the minimality condition on V, U G '. 
Let W, z, and m be as In Case I, and set t = r(xQ) - • Define 

h(w) as In Case I for (a) 1,2 and (b) i. 

(a)3- z G P^, z > (Xq); hj^(w) = for every 1 / 1, 


{b)2. 


z G w^: 

ZG Wy: 

h,(w) = 


h, (w) 
h^ (w) 


2 m-t-1+t 
p{z) 


2 m+1-t 
p(z) 



for z G P^ 


w G D(x^) 
w G DCXg) 
w G D(y^) 
w G D(y2) 


h, (w) 

2m 

p(x) 

211H-1 +t 
pU) 

2m-n -t 
p(y) 

2m 

pTyT 


for z ( 


h^(w) 

2m+1 

p(x) 


2m 


p(x) 


p(yy 

2 m+I 

p(y) 
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The proof that no it Is an equilibrium point proceeds as in 
Case I except that a more coii 5 )licated set of subcases must be examined. 

A. K(ir) n W = 0. Let z be as in Case lA. 

1 . z < g.l.b. (x,y}: Argument as in Case lA. 

2. z > g.l.b. {x,y}: Let z^ G and z^ G be the 
highest ranking intersections of K('n:) with and 

Wy respectively. There are two sub-sub-cases. 

(i) Either <( z^ or <( z^: Assume z^. 

Let ^ and let be identical with except 

that = V where ^ Then 

> r(Zy) + r(z^) > r(z^) + r(z^) = E^{n) 

a similar argument holds in case <( z^. 

(ii) < z^ and < z^. In this case both U*, 

G ‘W.j *, otherwise the minimality conditions on U and 
V are violated. Let be identical with except 

that for every U G *, x > U > z^, = V where 

X G D(V,U) . Then ) > 2m+r(yQ) > r(z^) + r(z^) = 

(It). The central inequality holds since r(z^) - 
i’(yo) ^ ^ <[ 

B. K(7t) n ¥ ^ 0. At most one of x and y is in K('n:) . Let 
denote the one that is in K(it) and 16 denote the other. Then oL 

a A ^ 

denotes x^ or y^ respectively, and z^ G G denotes the highest 

ranking intersection of K(n:) with w^. Note that '^o 

represent any w G K(ir) n ¥• 

1 . z^ < [ft } does not intersect w^ because of the 

minimality condition on di^. Let be identical with 

except that = V where G w^. Then 

> p(dL)h^(wQ) + i*(z^) > pK)hj^(w^) + r(z^) = Hj^(ic) 

2. z^ = 

There are four possibilities, depending on the choices 
at U, U, and V. The apparent eight resulting from 
two choices at each of three information sets is reduced 
by the fact that either U = U or else four of the 
possibilities give K('n:) n W = 9 and are treated above. 
Label the choices at U so that x G D( 1 ,U), y G D(2,U). 
U, U G * because of the minimality condition on V, 
therefore the choices at U, U are completely under the 
control of player 1 and we have the sub-matrices 



EQUIVALENCE OP INFORMATION PATTERNS 




H, (U ) 


Tf(V) 

1 

2 

1 1 

2m+r(yQ) 

2111+1 +r'(xQ) 

2 2 

2m+i+r(yQ) 

2m+r(XQ) 

Tr(U) 

HgCtr) 

1 

2 

1 1 

2iD+l+r(yQ) 

2m+r(yQ) 

2 2 

2m+r(xQ) 

2ni+1 +r(xQ) 


For any one of the foiir possibilities, one of the players can choose a 
strategy which will Increase his pay-off. 

Note that no essential modification Is needed In the preceedlng 
proof If we relax the minimality condition on requiring merely that 

It Is the lowest ranking position for which effectively perfect Information 
later falls and belongs to an Information set which Intersects both w^ 
and w . 

^ CASE III- Xq 7 ^ g-l.b. lx,y), U does not Intersect Wy. There 

Is no loss of generality In assuming that for every U $ If U 

Intersects w and w , then {x,y) C Uy for some V. This assumption 
—y A 

Is justified by the following: 

1. There Is a z £ V - D(U), such that for every U 6 Ug', 

U / V, that Intersects w^ and Wy, (x,z) C Uy for 
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some V. For assume that for* every z* G V, z* $ D(U), 
there Is a U G Ug*, (x,z) C Uy for any V. By the mini¬ 
mality condition on x, U < x^. 'Whence, hy the minimality 
condition on x^, U C Uy for some V, and hence D(U) C Uy 
for some v. But then, for every z*' G D(U) ^ V, and every 
z* G V - D(U), there Is a V G such that z' * G Uy, 

z* G U7|, Thus by Lemma 7 D(U) n V Is Isolated In V, 

contrary to the hypothesis that U' Is completely Inflated. 

We can take the z thus proved to exist to be y. 

2. There Is no U t U * U such that U Intersects 

and Wy and (x,y} i Uy for any V by the minimality 
conditions on x^ and x. 

5. There Is no U G ^ *, U < x^ such that U Intersects 

and Vy and (x,y} i Uy for any V, by the minimality 

condition on x^. 

4. If there Is a U G ', U > x^ and U Intersects w^, w^, 
{x,y} i Uy, then we have essentially Case II as noted at the 
end of the proof for that section. 

Let m and z be as In the previous cases. Let W = W u D(2 ,Xq) . 

Define an h as follows: 
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TT c -n^TT ^ m m+1 

^ 5T7r ^ 

Let W* = [D(2,Xq) u D(x)] n D(y) . We consider two cases. 

A. K(Ti) n W* = e. 

The argument Is the same as In Case II A 1, 2(1). 

B. K('n:) n w* ^ q. 

Here there are four cases, depending on the choice at U and V, 
summed up In the matrices 

H, (TT) H2(Tr) 




and for any pair of choices, there Is another choice open to one of the 
players which Increases his payoff. 
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INFINITE GAMES WITH PERFECT INFORMATION 
David Gale and F. M. Stewart 

INTRODUCTION 

The notion of a game with perfect information has been defined by 
von Neiomann and Morgens tern [ 2 ] J The concept corresponds intuitively to 
games like checkers and chess in which the moves and positions of a player 
are known to his opponents at all times. The principal result of the theo¬ 
ry states that a finite two-person zero-sum game with perfect information 
is strictly determined, that is, that such games have a value which can be 
achieved by pure strategies. Recently Kuhn [ 1 ] has obtained a generaliza¬ 
tion of this result for n-person games which are not necessarily zero-sum. 

In this paper we consider onl^ the two-person zero-sum case, but relax the 
condition of finiteness. Our first result shows that in this case the 
von Neumann theorem no longer holds and such games may be indeterminate. 

To Illustrate this somewhat paradoxical result we consider the 
"binary game." In this game players I and II alternately choose binary 
digits 0 or 1 . A play of the game consists of a countable number of 
such moves or choices. Thus each play consists of a sequence, s(0), s(1), 
s( 2 ), ... of digits which determines the real number s = wn=l s(n)/ 2 ^. 
Player I wins a dollar from player II if s belongs to a certain subset T 
of the unit interval, while player II wins a dollar from player I if s 
does not belong to T. It will be shown that the set T can be chosen so 
that no matter what strateg:y' player I uses, there is a strategy by which 
player II can win, while, contrariwise, for each strategy player II may 
elect to use there is a strategy by which player I can win. 

Since infinite games in extensive form have not previously been 
considered in the literature, it is necessary to devote the first section 
of this paper to setting up definitions and notation. In the second section 
a proof is given of the general indeterminacy theorem already mentioned. 

As might be suspected this proof depends heavily on non-constructive methods 
such as well-ordering. It is therefore natural to inquire if a game can 
still be indeterminate if the pay-off function is "well-behaved." For ex- 


^Numbers in brackets refer to the bibliography at the end of this paper. 
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ample In the binary game, how pathological must the set T be for the game 
to be Indeterminate? The remainder of the paper Is devoted to Investiga¬ 
tion of such questions, that Is, under what circumstances Is a game strict¬ 
ly determined? For this purpose we Introduce In section 5 the notion of 
the natural topology of a game and the concept of subgame. Certain simple 
topological conditions are sufficient to Insure strict determlnacy. In 
terms of the notion of subgame we define an absolutely determined game as 
one all of whose subgames together with certain other related games are 
strictly determined. Using these concepts we are able to give the state¬ 
ments of all the positive results which have been obtained. These are 
listed at the end of section 3* As an example of these results we mention 
that the binary game is strictly aetermined If the set T belongs to the 
Boolean Algebra generated by the open subsets of the unit Interval. In 
section 4 we give proofs of the results listed at the end of section 3» In 
the final section a niimber of unsolved problems are listed. As an example 
we mentioned the following open question: Is the binary game determined If 
the set T is a or an F^? 

Finally a word should be said about the reasons for considering 
games of the type described. Certainly such a game cannot be played in its 
extensive form, but It Is hoped that the techniques used here may have 
applications to infinite games In the normalized form. Furthermore, con¬ 
sideration of the counter example and the positive results in the infinite 
case sheds light on the von Neumann proof for finite games. Lastly, in 
certain tactical and chase problems one has a great deal, but not perfect. 
Information about the opponents * past moves. For such problems some exten¬ 
sive form may be more useful than the normal form. We hope that this study 
of games with perfect Information may suggest methods helpful In the study 
of some games with partial information. 

4 1 . HEPINITIONS AND NOTATION 

A fundamental problem which must be faced by anyone writing on 
games In extensive form is that of finding a notation which will adequately 
represent the situation and at the same time will not be too cumbersome to 
work with. It seems traditional that everyone who works in this subject 
Invents a new notation and we shall be no exception. Since we are dis¬ 
cussing only a special case of extensive games, namely two-person with per¬ 
fect Information, we have chosen a representation of such games which Is as 
simple as possible, and have not attempted to find a representation which 
will apply to more general cases. Also we have eliminated the possibility 
of "chance moves," again for the sake of simplicity. What we do In this 
section is to describe a mathematical model for the games to be discussed. 
It would be possible slrrply to define this model and proceed to prove 
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theorems about It without further explanation. The significance of the 
results, however, lies In their Interpretation as theorems about games and 
for this reason we have chosen to justify each definition by Its game theo¬ 
retic Interpretation as we go along. This procedure which seems essential 
to giving a clear understaridlng of the results, will necessitate a certain 
amount of "talk." The reader may test his understanding of the model by 
seeing how the binary game fits Into the general framework we are about to 
describe. 

A game in extensive form has been likened to a topological tree 
(see [1] and [2]). Each vertex of the tree corresponds to a particular 
"position" of the game and the branches Issuing from a given vertex corre¬ 
spond to the positions which are possible on the next move. The "root" or 
initial vertex of the tree corresponds to the initial position of the game. 
Further, each vertex of the tree Is assigned to player I or II according to 
whose move it Is at the position in question. The first object in our 
model of a game will then be a set X, the set of positions. This set Is 
partitioned into sets Xj and to represent the fact that at each 

position it Is the move of player I or player II. 

We must next describe how the vertices of the tree are connected 
together. Given a position^ x G X we must give a way of telling which 
positions X’ can be obtained from x on the next move. Such a position 
X* will be called an Immediate successor of x, while x will be called 
the Immediate predecessor of x* . A sinple way of describing this situa¬ 
tion is to give a function f which carries each position, x, onto its 
Immediate predecessor,^ f(x) . We must also distinguish a particular posi¬ 
tion, Xq, the initial position of the game. (Note that if Xq G Xj-j, 
then player II has the first move.) Every x G X except x^ has an im¬ 
mediate predecessor, and x^ is a (not necessarily immediate) predecessor 
of every x G X. These properties can be assured by iinposing the following 
conditions on f. 

(1 .1) f maps X - Xq onto X. 

(1 .2) For any x G X there is an integer n > 0 such that f^(x) « x^. 


^We use the standard notations, x G X for x is a member of the set X, 

X C Y for X is a subset of Y, and X u Y and X n Y for the union 
and intersection of the sets X and Y. The empty set is denoted by A. 

The set of all d(x) such that s(x) is denoted by {d(x) | s(x)]. The 
supremum of this set is denoted by sup ld(x) 1 s(x)} or 
f is a function f |X is its restriction to the set X- 

^We are assuming that each position has a unique immediate predecessor. In 
an actual game, say chess, one knows that the same disposition of the pieces 
can be arrived at by different successions of moves. This difficulty can be 
avoided if we consider a position as consisting not only of the arrangement 
of the pieces, but also of all previous arrangements. 
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Now X is a predecessor of y and y is a successor of x If 
for some integer n > 0, x = f^(y). If n = 1, x is the immediate prede¬ 
cessor of y and y is an immediate successor of x. 

The game is now played as follows. According as x^ is in Xj 
or Xjj player I or II picks a position x^ G (note that 

is the set of Immediate successors of x^). In general if n positions 
have been chosen, then according^ as x^ belongs to Xj or Xjj player I 
or II chooses a point x^^^ G f"’(x^). In this way a sequence of points 
(x^) is chosen by the two players. Such a sequence is called a play of 
the game. 

More precisely a sequence, s(0), s(l), ..., is a play of the 

game if 

(1 .5) s(o) = Xq , 
and 

(1.4) For any i>0, s(i)=l(s(i+l)) . 

The set of all plays is called the space of the game and will 
usually be denoted by S. 

To complete the description of the game it is only necessary to 
give a pay-off function , that is, a real valued function on the set S. 

If the players play so that outcome is s then player II pays player I an 
amount 2Ks) units. Most of our results are for the special case where 
is the characteristic function of a set Sj which will be called the 
winning set for player I ; = S - Sj will be called the winning set for 

player II . A play s of the game is a win for player I or player II ac¬ 
cording as s G Sj or s G 
To summarize 

DEFINITION 1. A game P is a collection of 
objects (Xq, X-J-, Xjj, X, f, S, $), such that 

(1.5) Xq ^ 

(1.6) Xj n Xjj = A, Xj U Xjj = X, 

(1.7) f is a function satisfying (1.1) and 

(1 . 2 ), 

(1.8) S is the set of all sequences satisfying 

(1.5) and (1.4), 

(1*9) 5 is a real valued function on S. 

^In most games the players move alternately. We shall no.t require this 
since its only result would be to complicate the notation. 
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EEPINITION 2. A wln-lose game p is a collection 
of objects (Xq, Xj, Xjj, X, f, S, Sj, Sjj) such that 
(1.5) - (1 .8) and 

( 1 . 10 ) Sj n Sjj = A ^ Sjj = S. 

A play of P is an element of S. It is a win 
for player I (player II) if it belongs to Sj (Sjj)• 

The above description conpletely defines the rules of the game. 

In order to discuss questions of determinacy it is now necessary to define 
the fundamental notion of a strategy. A strategy here is clearly a rule 
which in any position will tell a player what his next move shall be. 

DEFINITION 3. If P = (x^, Xj, Xj^, X, f, S, $) 
is a game, the set, 2i(P)> strategies for player I 
consists of all functions, <r, with domain Xj such 
that 

(1.11) <r(x) e 

The set, ]Sj-j-(r'), of strategies for olaver II consists 
of all functions T on Xjj- satisfying 

(1 .12) T(x) G f’(x). 

Now to every pair of strategies <r and T will correspond a 
unique play s of the game P. This play which we write as s = <r,r> is 
the play which results if the two players pick the strategies (r and T 
respectively, and will satisfy the following inductive definition. 


(1 . 13 ) s(0 ) = Xq. 

(1.14) If s(n) Q Xj then s(n + 1) =<r(s(n)) ; 

if s(n) Q Xjj then s(n + l) = T(s(n)) . 

We may now consider the pay-off function, §, as defined on 
pairs of strategies, as is usual in game theory. That is l(<r,T) = 

• The definitions of strict determinacy and of the value of a game 
now follow in the usual manner, ([2] p. 106 ) since we have now succeeded in 
putting the game in the normalized form. Thus P is said to be strictly 
determined and have value v if, 


®^<rG5;T(r) “ ®^<rG5;j{r) ^T62;jj.(r) ^ 


As usual with infinite games, we require only the equality of inflma and 
suprema rather than that of maxima and minima. 
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A win-lose game P = (x^, Xj, Xjj, X, f, S, Sj, Sjj) Is 
eq-uivalent to the game with pay-off, P* = (x^, Xj, Xjj, X, f, S, §1) 
where $ is the characteristic function of Sj. If P' has a value then, 
since 5 can assume only the values o and l , there is a <rQG2Jj(r) 
and a Tq ^ ^ * 

Inf-r^y (p) $ (<r^,r) = = v. The value, v, is 1, and (T^ 

always wins 5 for player I if and only if for all T G 

<(r^,T> G Sj. Similarly v is zero and always wins for player II if 

and only if ^ S^^ for all <r G 2^j(P) • 

DEFINITION 4. If P - (x^, X^, X^^, X, f, S, Sj, 

Sjj) is a win-lose game then the set, (D, (or 

X^X (P)) of wlnninp; strategies for player I (or 
player II) consists of all <r G (or 

T G 21 jj(P)) such that 

(1.15) r G Sii(P) implies <fl-,T> G S^ 

(or 

( 1 . 16 ) <rG Sj(n) inplies <<r,'r> G S^j .) 

DEFINITION 5- A win-lose game P is strictly 
determined if Xx A or 5)ij (P) 7 ^A- 

f 2 . THE INDETERMINACY THEOREM 

We now construct an example of a an infinite game with perfect 
information which is not strictly determined. 

At each turn the possible moves are i) choose the digit o and 
il) choose the digit 1. Thus X, the set of positions, consists of all 
finite sequences {a(l), a(2), ..., a(n)} where each a(i) is either 0 
or 1. The initial position is the sequence of length zero. A 

position (a(l), ..., a(n)} is in Xj if n is even, and in Xjj if n 
is odd. 

At each move a player cannot change the previous moves so 
f(Ca(i), ..., a(n)}) = {a(l), ..., a(n - 1)}. 

The set, S, of plays consists of all infinite sequences of the 
form (Xq, {a(l)), (a(l), a(2)), {a(l), a(2), a(3)), ... ). 

We now construct subsets Sj and Sjj of S such that the 
win-lose game P = (x^, Xj, Xjj, X, f, S, Sj, Sjj) is not strictly deter¬ 
mined . 

The construction is based on two facts. 

A. The number of strategies in 2y(P), (and in 
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2ii(P)) is 2^0. 

B. For each Tq t number of plays in 

Is 2 Similarly for each 

'>'o°6 SiCP), = «<r^,T>|T 6 SjjCD) has 
members. ^ 


PROOF OF A. Each function 9 on Xj to the set whose members 
are 0 and 1 determines and is determined by a strategy, G 2^j(P) 
where <rQ({a(l), a(n))) = {a(l), ...^a(n), 9({a(l), a(i:^})}. 

Since Xj has elements there are 2 ° such functions and 2 ° 

strategies. ^ 

PROOF OF B- There are 2 ^ infinite sequences {<*-(0), <#-(1), ... 
where <i(i) is o or 1 . Corresponding to each such sequence there is a 
play s defined inductively by: i) s(o) = x^; ii) if s(2n) = 

{a(l), ... a(2n)} then s(2n + 1) = {a(l), ... a(2n), oL(n)); lil) s(2n) = 
rQ(s(2n - l)). Distinct sequences determine distinct plays. 

For each such play, s, there is a (not unique) strategy <r 
such that <<r,TQ> = s. E.g., let <r(s(2n)) = s(2n + 1) and (r(x) is 
arbitrary if x 9 Xj but x s(n) ^ov any n. 

Thus there are at least 2 ° elements in ^ 

Since S ^tself has only 2^°, S^ = Si(P)^ 5^ve 

exactly 2 ° elements. ^ 

The proof for S^^ is similar, 
o 

We proceed to the construction of Sj and ^ 

Let OL be the least ordinal such that there are 2 ° ordinals 
less than <*.. By A we can index the strategies in ]Sj(P) as o^, 

< d}. Similarly we can index the strategies in SjjCP) as T^, 

G (iflK < d.]. 


° ^o 


so that t^ ^ Sq. Proceed 


Choose Sq G S^j. . Choose 

inductively. If 
{t^l^f < has fewer than 

Choose one of its elements and call it s^. Similarly S^^ - (Sy|Y ^ fi) 


have been chosen for all Y < ^ < d. the set 

2 ^° members so S.,. - (t^|Y < ^) is not empty 

/5 


is not empty. Call one of its members t^. 

We now define ACS by the rule A = < d), and B C S 

by the rule B = {ty|Y < d], and we assert that the sets A and B are 
disjoint, l.e., for any If and p, Sy ^ t^. 

CASE I. If » £ then t^ t < fi) so 

t- i CSjU < p) and therefore t^ / Sy. 

CASE II. If V y p then Sy 6 S^ - so 

Sy ( < V) and therefore Sy t^- ^ 
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We now partition S into two sets Sj and Sjj in any manner 
provided only that A C Sj and B C To show that the game so defined 

is not strictly determined it suffices to show that 

(see DEP. 5). Let <r be in Sj(r') • Then cr corresponds to some index, 
say /8. By construction there exists a play t^ such that V 

hence there exists T G Sjj(n such that = t^ G B C S^-j. Thus 

t Si hence 5)^ (P) =A- Symmetrically one shows that 

^ hence the theorem is proved. 

Thus P is not strictly determined and we have 

THEOREM 1 . There is an infinite game with perfect 
information which is not strictly determined. 

^ 3. THE TOPOLOGY OP INFINITE GAMES 

Our positive results about strictly determined games are most 
easily stated in terms of a natural topology on the set, S, of all plays. 
Each play is a function from the non-negative integers to the set, X, of 
positions. The topology imposed on S turns out to be that of polntwlse 
convergence of the functions if X is given a discrete topology. 

Throughout this section we will give most of our attention to 
win-lose games, but the definitions and results are equally applicable, 
mutatls mutandis, to games with pay-off. 

NOTATION. If P = (Xq, Xj, Xjj, X, f, S, Sj, Sj-j) 
is a game and x G X then 

'U(x) = {s|s G S and, for some i, s(l) = x] . 

One easily verifies that the 1 is the same for all s G TX(x) 
and is the Integer 1 such that f^(x) = x^. 

LEPINITION 6. If r= (Xq, Xj, X^^, X, f, S, Sj, 

Sfi) is a game and s G S, a neighborhood of s is 
any “(/(x) containing s. 

Note that ‘U(x) is a neighborhood of s if and only if x = s(l) 
for some integer 1 > o. 

THEOREM 2. If P = (x^, Xj, X^^, X, f, S, S^, 
is a game the neighborhoods of points of S determine 
a Hausdorff topology for S. In this topology S is 
totally disconnected. 
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The proof is a routine matter of verification. We will wish, 
however, to refer to the following facts. 

(5.1) If f^(x) =y then ll(x) C U(y) 

( 5 . 2 ) If, for every 1 > 0 , neither f^(x) = y nor f^(y) = x 

then UL(x) f\ = A . 

We shall call a wln-lose game P open or closed according as 
the set Sj is open or closed. 

It is desirable to be able to consider finite games with perfect 
information as a special case of Infinite games. There is a slight dif¬ 
ficulty in doing this since by our definition of a game each play Involves 
an infinite number of moves. This can be gotten around, however, by 
introducing "dummy" moves, that is, positions such that the player whose 
move it is has only one alternative. Such a position shall be called 
ineffective . In terms of our notation the position x is ineffective if 
f“^ (x) contains only one element. Thus chess may be considered an in¬ 
finite game by making all positions which are successors of a checkmate or 
stalemate Ineffective. 

Consider now the following three flnlteness conditions. 

DEFINITION 7- An infinite game P (x^, X^, Xjj, 

X, f, 3, $) satisfies condition F.l, or P. 2 , or P.5 if> 

respectively, 

(F.l) X contains only a finite nimiber of effective 
positions; 

(F. 2 ) there is an N such that for all s G S, n > N 
inplies s(n) is ineffective; 

(F.3) For every s G S only a finite number of the 
s(n), n = 0 , 1 , ..., are effective. 

Note that (P.l) implies (F. 2 ) and (P. 2 ) inplles 

(P.5). 

We now state a result connecting the notion of finiteness with 
the topology of a game. The proof is straight forward and we omit it. 

THEOREM 3. The game P satisfies the condition 

(F.3) if and only if the space of P is discrete. 

Von Neumann has proved [2, pp. 112-128] that finite games with 
perfect information are strictly determined. His methods — in particular 
section 15.8 — can be extended to show that every game satisfying (F.3) is 
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strictly determined. However, this result turns out, in view of Theorem 5, 
to be just a special case of our Theorem 15- There need not, however, be 
a strategy which ensures the achievement of the value. This situation is 
clarified by Theorem l 6. 

Another concept Intimately related to the topology of a game is 
that of a subgame. 

DEFINITION 8. A wln-lose game P* = (x^*, X^*, 

Xii', X*, f*. S', Sj*, Sj-j') is a subgame of 


r = (x^. 

Xj, Xjj, X. f, S, 3j, Sjj) 

if 

( 5 . 5 ) 

^ 0 * “ ^0 


(3.4) 

Xi* C Xj. Xjj- C Xjj 


( 3 . 5 ) 

11 


( 3 . 6 ) 

Sj' = Sj /I S', Sjj' = Sjj 

n S' . 

For 

games with pay-off (3.6) Is 

replaced by 

(3-7) 

03 

II 

m 



Intxiitively a subgame is obtained by adding new rules forbidding 
certain moves. E.g., if two chess players agree to use a particular 
opening, they play a subgame of chess rather than chess Itself. 

The connection between subgames and the topology is embodied in 
the following two theorems whose proofs will be found in section 4. 

THEOREM 4. If P* = (x^*, X^', X^j-', X», f. S', 

Sjj') is a subgarae of P = (x^, Xj, Xjj, X, f, S, Sj, 

Sfi) then S' is a closed, non-empty subset of S. 

THEOREM 5. If r= (x^, X^, X^^-, X, f, S, S^, S^j) 
is a game and F is a closed non-empty subset of S 
then there is a unique subgame of P whose space is F 
with its relative topology as a subset of S. 

NOTATION. If F is a closed, non-enpty subset of 
S then the corresponding subgame of P will be denoted 
by Pp, and 3^, X^^., X^, S^, S^, will denote 

the objects such that Pp = (x^, Xj, Xjj, X^, S^, 

Sj, Sjj). If F Is a neighborhood HCx) we will 
use P^, Xj, etc. Instead of etc. 

We now define certain simple set theoretic operations on games. 

EEPINITION 9. If P = (Xq, Xj, Xjj, X, f, S, Sj, 

Sjj) and P* — (Xq, ^II^ ^I*^ ^II*^ then 
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we define the Intersection of P and p* by 
P HP* = (x^, Xj, Xjj, X, f, s, Sj n Sj*, s - (Sj s^-*)) 

and the imlon of P and P* by 

P^P* = (Xq, Xj, Xjj, X, f, S, SjU SjS S - (Sj Sj»)) . 

Note that unions and Intersections can only be defined for pairs 
of games having the same x^, Xj, Xjj, X and f. 

HEFINITION 10. We define the negative of the game 
P = (Xq, Xj, Xjj, X, f, S, Sj, Sjj) to be the game 

- r= (X^, Xj, Xjj. X. f, S. Sjj, Sj). 

In section 5 we give examples to show that the unions. Inter¬ 
sections, and negatives of strictly determined games need not be strictly 
determined. Accordingly one Is led to consider the following stronger 
condition of determlnacy for a game. 

HEPINITION 11. A wln-lose game P Is absolutely 
determined If all subgames of P and - P are strictly 
determined. 

We are now In a position to state our remaining results. The 
proofs of most of them will be given in the next section. 

THEOREM 6. The union of an open game and an 
absolutely determined game is strictly determined. 

COROLLARY 7- An open or closed game Is strictly 
determined. 

COROLLARY 8. A discrete game Is strictly deter¬ 
mined . 

COROLLARY 9. The intersection of a closed game and 
an absolutely determined game Is strictly determined. 

COROLLARY 10. An open or closed game Is absolutely 
determined. 

THEOREM 11 . The Intersection of an open game with 
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an absolutely determined game Is strictly determined. 

COROLLARY 1 2 . The tinlon of a closed game with an 
absolutely determined game is strictly determined. 

COROLLARY 13- The union and intersection of an 
open or closed game with an absolutely determined game 
are absolutely determined. 

THEOREM If T = (x^, X^-j, X, f, S, 

and Sj belongs to the Boolean algebra generated by 
the open sets then P Is absolutely determined. 

THEOREM 15- If P = (x^, Xj, Xjj-, X, f, S, $) Is 
a game with pay-off and 5 is continuous then P Is 
strictly determlnea. 

THEOREM 16 . If P = (x^, X^, X^^-, X, f, S, §) is 
a game with pay-off the following ttiree conditions are 
equivalent: 

1) For every x G X, f"^(x) is a finite set. 
ii) S is compact. 

iii) For every continuous pay-off function Y on 
S the value, v*, of P' = (x^, Xj, X^-^, X, 
f, s,-y) can be achieved. (I.e., there Is a 

cTq G ^ ^ ^II^^'^ such that 

i . PROOFS 

This section consists of the proofs of Propositions 4 through l6. 
PROOF OF THEOREM 4. Since P' is a game. S' cannot be empty- 
Let s be any element of S - S*. For some n, s(n) $ X* since S' is 

the set of all sequences satisfying (1.3) and (1.4) with f = f|X' in 

place of f. Now if t G ‘U(s(n)) then t(n) = s(n) $ X* so S - S' 

contains a neighborhood of s. Thus S - S' is open and S' is closed. 

PROOF OF THEOREM 5- Let X^ = lx|x 6 X and ll(x) 0 F A), 

3^ “ Xj A X^, X^j = Xjj n X^, f^ = flx"'^, = P, = Sj. A P, = Sjj AP, 

and Pp = (Xq, X^, X^j, X^, f^, S^, S^, s|j). Since (3.3) - (3-7) are 
obviously satisfied, Pp is a subgame of P if Pp is a game. ¥e proceed 
therefore to verify that P^ satisfies ( 1 . 5 ) - (1-9). 
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Clearly (1.5) and (1.6) are satisfied. 

Now (1.1) and = f Ientail (1.2) so (1.7) depends only on 
verifying (1.1) for f^. Since U(x) ^U(f(x)) the range of f^ Is 
contained In X^. By definition, if x G X^ then there is an s G F and 
an Integer n > 0 such that x = s(n). But s G U(s(n + l)) so 

s(n + 1) t X^ and x = s(n) = f(s(n + l)) = f^(s(n +1)) so the range 

of f^ contains X^. 

As above if s G F then s(i) G X^ for every integer i > 0. 

Thus (1 . 5 ) and (1 .^) hold for every s G F. Hence to establish (1.8) we 
need only show that every sequence, s, satisfying (I. 3 ) and (1.4) belongs 
to F. If s(0) = Xq and s(i - 1 ) = f^(s(i)) then s(i) G X^. Hence 
every neighborhood, t^sd)), of s contains points of F. Since F is 
closed, s G F. 

Condition (1 . 9 ) is clearly satisfied. 

Thus Pp is a subgame. We now show that it is unique by 
assuming that P’ = (x^, X^, xj^, X*, f*, F, sj, sj^) is a subgame and 
proving P* = Pp. 

By (3.5), x; = x^. 

If X G X* then by (1.1) there is an n such that f (x) = x^. 

Set s(i) = f*^"^(x) for 0 < 1 < n. Since f is onto (i.e., (1.1)) we 

can, by induction, define s(i) for i = n+1,n+2, ... so that 
s(l) = f'(s(i + 1)). By (1.8), s GF. Since s G ■U( s(n)) = 'U(x) it 
follows that x G X^. 

Conversely if x G X^ then, for some s G F and some integer 
n>0, x=s(n). Using (1 .8) and (1 .4) s(i) G X* for all i, and in 
particular x = s(n) G X* . Thus X^ C X* . 

Hence X^ = X* and, by (1.6), (5.4) and the definitions of 

Xj and Xjj, X^ = X^ and X^^- = X^j. 

From ( 3 . 5 ) and (3-6), f* = f|X-^ and Sj = Sj A F and 
= Sjj A F which completes the proof. 

In the following proofs we need to know something of the rela¬ 
tionship between strategies in a game and those in its subgames. If 
r« = (Xq, xj, xjj, fS S*, sj, Sjj) is a subgame of P a strategy 
^ ^ SjfP) ^ extension of (t* ^ ^ 

(4.1) . 

Extensions of T‘ G are defined similarly. Clearly every strate- 

gy for a subgame has an extension which is a strategy for the original game. 

lemma 4.1. If 

p. = (x„, x', xjj, X'. f. S', sj, sjj) la a 
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subgame of P 

(‘^.3) T G SjCr*) is an extension of <r' G SjCr”) 

T G Sii(f’) 

(4.5) <<r,-r> G S> 

then there is a T' G 5xi(r') such that <<r',T'> = 

<<r,T>. 

PROOF. Let <<r,T> = s. By (4.5), (1.4), and (3.5) 3(1) G X= 
for all 1. Let T‘(s(i)) = sd + 1) if s(l) G xjj, and let T'(x) be 
any element of f'"’(x) If x G xjj and x ^ s(l) for each 1. let 
s' = < 0 -' ,T'>. If s(i) = s' (1) G XJ then by (4.1) and (4.3) s(i+l) = 
<r(s(l)) = <r'( 3 '(l)) = s'(l + 1). If 8(1) = s'(l) G Xjj then 3(1 + 1, = 
T(s(l)) = s'(l + 1 ). Since 3(0) = = s'{o) ve have s - a' by In- 

duction. 

LEMMA 4.2. If P • 1^ 

is a game; Y C X; for each y G Y, there is a 
«"y G Sx(f’y); and o’o ^ Si(f’) l^en there Is a 
TG 2j(C) such that for each T G either 

(4.6) <<r,r> = <<rQ,T> G Uy^ylKy) 
or 

(4.7) For some y G Y anu some Ty G Sll(fy). 

<<r,t> = <- V 

PROOF. If z Is a successor of some y G Y let (|)(z) be the 
"last" predecessor of z in Y. I-e., (|>(z) = where 

n(z) = si;^) {l|f^(z) G Y). Let 

r ir^(x) If X G Xj and, for all 1 > 0, f^(x) G X 

<r(x) = 

L *G(x)^*^ ^ X G Xj and, for some 1 > 0, f^(x) G Y. 

If Tg 2ii(r’) let 3 = <<r,T>. 

If 3 G then there is a least Integer n such that 

s(n) G Y. For x = f^(s(n)) = s(n - 1) G Xj, i = o, i, ..., n, 

(r(x) = s(n - i + 1) = so <r is an extension of . By 

Lemma 4.1 there is a G Sii(r’a(n)^ <<'",r> = Vg(n)>'^ 3 (n)^‘ 

If s G then 3(1) GY for each 1. Hence If 

3(1) G Xj, s(i + 1) = (r(s(l)) = a-^{3{i)) so <(r,T> =<.(r^,ry. 

LESfflflA 4 . 3 . If P' Is a subgame of P, <r G 5)i(r) 

Is an extension of <r' G ]Sj(P'), and TG Sjj(r') Is 



INFINITE GAMES WITH PERFECT INFORMATION 


239 


an extension of T' G then <<r,T> = <<r', t'>- 

PROOF. Let s = <<r,T>, s' =<<r',T'>. By (3-5) and (1.3). 
3 (o)=s'( 0 ). If s(l) = s'(l) £ Xj, then, by (3.5), s(l + 1) = (r(s(l)) 
(r'(s’(l)) = s'(l + 1 ). Similarly If 3 ( 1 ) = s'(l) G Xjj then 3(1 + 1) = 
T(s(l)) = T'(s'(1)) = 3 ' (1 + 1). In either case s(l+ 1) =s'(l+ 1). 
Hence by induction s(i) = s'(i) for all 1, or s = s'. 

LEMMA 4.4. If r = (Xq, Xj, Xjj, X, f, S, Sj, Sjj) 

Is a game, f(x) G Xj, and (Pj^) is not empty then 

Si (f^f(x)^ empty. 

PROOF. It la clear tliat Is a subgame of Pf(x) ‘ 

«■' G 2^1 (Tjj) let <r G Sj(r'f(x)) extension of o"'. If 

T G Sii(t’f(x)^ then, since f(x) G Xj, T' = T|Xjj G Sij(f’x5 • Lemma 

4 . 3 , <«',T> =<<r',r'> G Sj because cr' G ^i ^’’x^ ‘ ^ Sj (f’f(x)^‘ 

LEMMA 4 . 5 . If P= (Xq, Xj, Xjj, X, f, S, Sj, S^j) 

Is a game and If x G X, such that f(y) = x Implies 
^I ^^y^ enipty, then ^ empty. 

PROOF. If X G Xj then Xj (J’x^ empty by Lemma 4.4. 

If X G Xjj let Y = f”' (x). For each y G Y choose 
O" G Xi (r* ). Let (Tq be any element of Xj(P) • Let o" be a strategy 
determined from Y, 0"y, according to Lemma 4.2. Since Uygyl((y) = s’^, 
(4.6) can never hold. Thus for any T, and some y G f (x), <r,T> = 

<(r ,T > where Ty G X:^jiPy) ■ Since a-^ G (f’y) > G Sj. 

To avoid, unnecessary repetition we do not prove the dual lenuuas 

with the roles of the players interchanged. 

PROOF OP THEOREM 6. Let G be open In S and let P be 
absolutely determined. We shall show that 

r- = (X,, Xj, Xjj, X, f, S, Sj u G, Sjj - G) 

is strictly determined. 

Let 


P* = (X^, Xj, Xjj, X, f, S, G, S - G) , 
W* = (xlXi (Px^ empty) , 
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If ^Kx) C G then every <r G player I, so x G Wj. 

Since G is open It Is the imion of all neighborhoods contained in it. 
Hence 

(It.8) G C - 

If Xq G Wj then any <r G j (P* ) will, a fortiori, win P' . 

■Jt ^ 

If Xq t Wj then, by induction using Lemmas 4.4 and 4.5, there 
is an s G S such that s(l) $ for each i. Accordingly s G F, so 
F is not void and determines a subgame, P^, of P. 

Since P is absolutely determined it remains only to show 
A: If ^ (r») A. and 

B: If Sn Cr-p) ^ A then Xjj (P*) / A- 
PROOF OF A. For each x G Wj choose cr^ G ' Choose 

G Xx extension of <r^ . By Lemma 4.2 there 

is a 0 “ G 5)j(P) such that for each r G 5)jj(P) either 

(4-9) <^,r> - G F 

or 

(4.10) For some x G Wj, and some G 

<<r,r> == <<r^,r^> . 

If (4.9) obtains then, by Lemma 4.1, there is a G Sjj(Pp) 
such that <<r,r> = Because o-^ G Xi ^ 

If (4.10) obtains then, since cr^ G 2)j (Px^ > ^ G* 

In either case <<r,T> G S^ u G so cr g X^ (P*) • 

PROOF OF B. Choose q (Pp) • Choose T(x) = r^U) if 

X G Xjj ; r(x) is any element of f*”^ (x) - if such exist. If x is 
any other element of Xjj then T(x) is any element of f (x) . Let <r 
be any element of Xj(P*) - If G P then by Lemma 4.1 and the fact 

that 

e 6 P - Sj = S - - Sj C Sjj - G . 

If <tr,T> = s t P, then there would be a least Integer n > o 
such that s(n) G Wj. By Lemma 4.4 s(n - 1) = f(s(n)) $ Xj. But if 

s(n - 1 ) GXjj - Wj then by Lemma 4.5 there would be a 
yGf"^(s(n-l)) -Wj. Accordingly, by the definition of T, 
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s(n) = T(s(n - 1 )) G f”^(s(n - 1)) - Wj, which is iinpossible. 

Thus for every tr, <<r,T> G S^j - G. 

PROOF OF COROLLARY 7- Apply Theorem 6 to the special case where 
the absolutely determined game is P = (x^, Xj, X^j, X, f, S, A, S) . This 
proves the corollary for open games. If P = (Xq, Xj, Xjj, X, f, s, Sj, Sjj) 
is closed then T' = (x^, Xj-j, Xj, X, f, S, Sj-j, 3j) Is open. The corol¬ 
lary then follows from the obvious 1-1 correspondences between 
and between Sj;j(P') and SjCD which maps winning strate- 

gies onto winning strategies. 

PROOF OF COROLLARY 8. In a discrete game every set Sj C S is 
open. Hence by Corollary 7, a discrete game is strictly determined. 

PROOF OP COROLLARY 9- Let n= (x^, Xj, X^j, X, f, S, Sj, Sj-j) 
be absolutely determined and let F be a closed subset of S* We must 
show that n* = (Xq, Xj, Xjjy f, S, Sj A F, S - (S^ OF)) is strictly 
determined. 

Consider the game 

p" = (Xq, Xjj, Xj, X, f, S, S - (SjA P), Sj A F) 

and note that S - (Sj A F) = u (S - F)• Since P Is absolutely 

determined P" Is by Theorem 6 strictly determined, ana reversing the 
roles of the two players again shows that so Is P'. 

PROOF OP COROLLARY 10. Let S^ C S be open. If 
Pp = (Xq, x|, X^j, X^, = F. Sj A F, Sjj A P) Is the subgame of P 

determined by the closea subset P then the topology of S Is just the 
relative topology of P as a subset of S. By the previous corollaries 
Pp and - Pp = (x^, X^, X^j, X^, f^, S^, Sjj A P, Sj A P) are strictly 
determined. 

PROOF OF THEOREM 11 . Let P = (x^, Xj, Xjj, X, f, S, Sj, Sjj) 
be absolutely determined and let G be an open set in S. We must show 

that (Xq, Xj, Xjj, f, S, Sj n G, S - (Sj AG)) is strictly determined. 

Let 

Y = {xlU(x) C G and ^ 

Z = {xl'U(x) C G and Xji ‘ 

For y G Y choose <r G ^ (P ). For z G Z choose G (P^,) • Let 

r* = (x^, Xj, Xjj, X. f. s, l4eYU(x), S - By Corollary T P* 

is strictly determined. 

CASE A: 2;^(r*)?^A. 

Choose (T e 2 j(r») and determine a strategy using Y, r^, 
and <r^ as In Lemma h.Z. 
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I,et T be any element of 2ii(P)- Since <Tq,7> 

(If.6) cannot obtain. Hence for some y C Y and some Ty G Sjj;(Py)> 

<(r,T> = <<r ,Ty>. Since G (Py). <'^y>V ^ Sj n U(y) C Sj- n G. Thus 

<r G 2:^(r*)- 

CASE B: Sii (P*) 5^ A- 

Choose Tq G (P*). We can apply the dual of Lemma if.2 

to the set Z, the strategies z Q Z, and to determine a 

T G SjjCn*) such that for any <r G either 

(4.11) <o-,r> = <<r, $ 
or 

(4.12) for some z G Z and some cr^ G Xj(n 2 ;)> * 

If (4.11) obtains then, since G (P*), = 

<^,T'o> ^ ‘ this and (4.11), G S - 

Since P is absolutely determined and G is open, 

^ - ^yGY^y’ - 4 ;Gz'’^^"‘^ “ ^ ' 'iKx)CG^(’') = S - G C S - (Sj. rf G) . 

If (If. 12) obtains then, since G 2^x1 (Pz^’ = 

6 Sjx = S - Sj C S - (3j n G) . 

In either case T defeats <r, so TG (P')- 

The proof of Corollary 12 is like that of Corollary 9• 

PROOF OF COROLLARY 15- Let P= (x^, Xj, X^j, X, f, S, S^-, S^^) 

be absolutely determined and let T be an open subset of S. We must show 

that (Xq, Xj, Xjj, f, S, Sj u T, Sjj - T) and 

(Xo, Xj, Xjj, f, S, Sj A T, S - (Sj AT)) are absolutely determined. 

Let F be a closed subset of S. Now (Sj u T) A F = 

(Sj a F) u (T A F) and (Sjj - T) A F = (Sjj n F) n ((S - T) A F) . Since 

the topology in S^ = F is its relative topology as a subset of S, 

(Xq, X^, X^, f^, S^, (Sj u T) nF, (Syy - T) n F) and 

(Xq, X^, X^j, X^, f^, S^, (Sjj - T) flF, (Sj UT) AF), are, by Proposi- 

tions 6, 9, 11, an(i 12, strictly determined. I.e., 

(Xo, Xj, Xjj, X, f, S, Sj u T, Sjj > T) is absolutely determined. 

We omit the proof for (x^, Xj, Xjj, X, f, S, Sj A T, S - (Sj A T). 

PROOF OF THEOREM l4. Because the topology of the space of a 

subgame is the relative topology it will suffice to show that P is 
strictly determined. 

Every element of the Boolean algebra generated by the open sets 
belongs to a Boolean algebra generated by n particular open sets. We 
assume that the theorem is true if Sj belongs to a Boolean algebra 
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generated by n open sets and prove that it then holds with n r^laced 
by n + 1 . Corollary 1 5 ensures that it is true for n = 1 . 

We assume that Sj belongs to the Boolean algebra generated by 
the open sets G^, • • •, G^^^^ . We give the proof for the case 




G^ n 


0 G. 


h+1 


C Sjj (G^ here denotes S 


- Gi) 


The proof for the contrary case, G^* n ... A G^^^^ C Sj is obtained by 
interchanging the roles of the players. 

Let Y = (yl'U(y) C G^^ for some i and (Py) ^ , 

Z = (zITKz) C G^ for some i and A) • For each y G Y 

choose cr G Xj z G Z choose T^. G ' 

If U(x) C Gr^ for some i then Sj = Sj A U(x) C Sj A Gj^. Thus 
Sj belongs to the Boolean algebra generated by G^ aU(x), •••, 

G^ , nlZ(x), G^^^ aU(x), aU(x). By the inductive hypothesis 

is strictly determined so x G Y UZ and, using (^-13) 

{4.U) Sj C G, U ... uGj^^i = ^ 146z'*^z) • 


By Corollary 10, P 

is strictly determined 


- (Xq, Xjj 


Xjj, X, f, S, Uyg^-U(y), 


We thus have two cases to consider. 


s - U Y^y)) 

CASE A: (r') A- 

Choose c-Q G and let (r be determined from Y, <r^, 

and 0“ according to Lemma k.2. Let T be any element of ^jj(P). 

° Since <r G (T'), (^^•6) cannot hold. Thus from (4.7) there 


is a y G Y and a Ty G 


(p ) such that <0',T> = Since 


"II^’ y 




and 


(TG 2:1 (D- 


CASE B: (P') ^ A- 

Choose Tq G 2;jj (PM and let r be determined from Z. T^. 
and Tq according to the dual of Lemma 4.2. If (TG 2i(P) either 


(4.15) 


<(r,T> = <<r,T^ i ‘^ 2 Gz‘’^( 2 ) , 


(4.16) for some z G Z and some G 5^j(P2)» ' 

If ( 4 . 15 ) holds then, since G (P')» t ' 

Combining this with (4.15) we see by (4.14) that <<r,t> ( Sj. 

If (4.16) obtains then, since G ^ Sjjn'U(z). 

In either case <(r,T> G Sjj so TG Xii • 

PROOF OF THEOREM 15 . Let ^ ^ • Since S 
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Is continuoTis = (x^, Xj, Xjj, X, f, S, S^, S - S^) is strictly 

determined. Let v = sup {<i| ^ j (P^) y^A)- If < v then there is an 
oL, < rf. such that (P^) is not void. Choose tr^ G 2) j (P^l^ ^ Sj(P) • 

If r G Sjj(P) = then <%,r> G so $«<r^,r» ><=»-> . 

Thus s^^eVj(p) ^T6 ^jj(P) > ^r6Sjj(P) ^1 • 

Similarly if > v then there is an c>l < Vg such that 
2 jj (r^) is not void. There is, as before, a such that 

<""< ^ 2 - 

since < 

infj-g^ i«<r,T» for any f. It follows that 

^reSjjCD supffe2^(P) ^TiXjx^n 

PROOF OF THEOREM 16 . We omit details. 

If f"^(x) is Infinite then the set fU(y)|y G f”^(x)) u 
{K(z)|lL(z) A U(x) = A} is a family of open sets covering S. No finite 
subfamily can cover S- Thus ii) implies i). 

By setting up a i - l mapping from S into a closed, totally dis¬ 
connected subset of the unit interval one can show that i) irrplies ii) . 

We omit the construction of a fmction ‘T* showing that when i) 
falls so does iii). 

To show that 1) implies ill) one places on the sets of strate¬ 
gies a topology analogous to that on S. Then <C^,T> is a continuous 
function of cr and T. If i) holds then both 5Jj(P) and 2jj(n) are 
compact. Using the S^, of the proof of Theorem 1 5 one notes that 
S - is closed. From this and the continuity of it follows that 

Xjx closed. Now oL > p implies 2^^^ (P^) C 2^ii • Choose 

a sequence oL > «C> ... > v converging to v. There is a T ^ 2 Jtt ^ 

for all n > 0. For any cr G 2i(P)^ 1 «^,Tq>) < so $«0",rQ>) < v. 

i 5 • EXAMPLES AND QUESTIONS 

Simple examples obtained by inserting indeterminate games as 
subgames show that various plausible conjectures are false. Throughout 
this section P* = (y^, Yj, Yjj, Y, g, T, Tj, Tjj) will stand for some 

fixed game which is not strictly determined. The reader will find that 

sketching the topological tree corresponding to the rather laborious des¬ 
criptions given makes the ideas comparatively transparent. 

EXAMPLE 1 . A subgame of a strictly determined game need not be 
strictly determined. 

Let {Xq, x^, ...] be any sequence of distinct positions. Let 

Xj = Yj u {Xj^li is odd], Xjj = Yjj u lx^|i is even), X = Xj vj Xjj, and 
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let f (x) = g(x) if X € Y - y^, f (y^) = x^, f (x^^) = Xj^_, if 1 > l • Let 
Sjj be (IXjj, y^, y^, ...IKy^^, y,, ...} e Tj-j) together with the sequence 
{Xq, x^, •••) and let Sj = ((x^, y^, y,, ...)I(y^, y,, ...)GTj), 

S = Sj u Sjj. If r= (Xq, Xj, Xjj, X, f, S, Sj, Sjj) then any 

T 6 Sjj(r') such that ^Cx^) = x^ belongs to 21 jj (P). The subgame 
determined by the closed set tlx^, y^, y, ...)| (y^^, y^, ...) t T) C 3 is 
not strictly determined. 

EXAMPLE 2. The game V = (x^, X^, X^^, X, f, S, Sj, S^^-) may be 
strictly determined while - P = (x^, Xj, Xjj, X, f, S, Sjj, Sj) is not. 

Let Xj, Xjj, X, f be the same as in Example l . Let be 

((Xq, Jq, y -,5 ^ Tj) together with (x^, , .. •) and 


let Sj 

be 

Kxo, 

Yq, y,. •••}|(Yo, y,. 

...) G Tjj ]. Again 

TCXq) = X, 

implies 

r G 


(P) . Each strategy in 

Sj(“ P) consists 

of a function 

on x,j, ; 

X 3 ,. 

' • • 9 

and a function on Yj. 

If r 6 Sii(- P) 

and T(Xq) = x. 

then for 

any 

cr G 

Si(- r*), <<r,T> = IXq, 

X,, ...) G Sjj 30 

Ti Sn (- 


On the other hand if '^'(Xq) = y^ then <0",r> = s, where s(o) = x^, and 

s(i + 1) = t(l) and t - <(r*,T*> with (T* Q > r* G . 

Since P* is not strictly determined neither is - P. 

EXAMPLE 3. The intersection and imlon of strictly determined 

1 2 

games need not be strictly determined. I.e., there are sets Sj and Sj 
such that Pj^ = (Xq, Xj, Xjj, X, f, S, s|, S - 3^) are strictly determined, 

but r= (Xq, Xj, Xjj., X, f, 3, Sj u 3^, 3 - (sj. u s|)) is not. 

Let P-] be the game of Exanple 1 . Let s| consist only of 

[Xq, x^, ...) . 

An Interchange of the roles of the players shows that union may 
be replaced by intersection. 

example 4. There are games P = (x^^, Xj, Xjj, X, f, S, Sj, S^j) 

and P' = (x^, xj, xjj, -XS f. S', sj, sjj) and a function « such that 
P is strictly determined while P' is not, although^ $ is a^homeomorphlsm 
of 3 onto S' which carries 3j and Sjj onto 3^ and 3j^. I.e., 
strict determlnacy is not a topological invariant. 

Let r* = (y^, Y^, Y^J, g^, t"^, T^, T^j) ,1=1,2 be two 
replicas of P* - Let x^, x,, Xg be three distinct positions and let 

(z^, z^, ...) 1 = 1, 2 be two infinite sequences of distinct positions. 

Let’ Xj and xj both consist of x^. all z^ with j even and all 

y G Yj u Yj. Let Xjj and X-j-j consist of x^, x^, all zj with j odd 
and all y € Y^^ Let X = X' = X^ ^ X^^. Let fCy^) = f'(y^) = 

gl(y^) for yi 6 Y^-yo^, = "'l' 
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f'(z^) - f(y|) = Xg. 

Let Sj be all sequences of the form (x^, Xg, y^, , ...) 

with {y^, y|, ...] 6 Tj, i = 1, 2, together with (x^, x,, z|, ...) 

t 

1 = 1, 2. Let S and Sjj be determined accordingly. Let Sj be all 

sequences of the form (x^, x^, y^, y|, ...} with (y^, y|, ...} t Tj, 

i = 1, 2, together with (x^, x^, z^, z|, ...), i = 1, 2. The homeo- 
morphism $ is 

<|)({Xq, Xg, yQ, y|, •••)) = {Xjj, X^, y^, y\, ...) . 

(||({Xq, x^, Zq, z^, ...)) = (Xq, x^, Zq, z|, ...) . 

We now list some questions whose answers we should like to know. 
QUESTION 1. Are there examples in which every subgame of 
r* = (Xq, Xj, Xjj, X, f, S, Sj, Sjj) is strictly determined, but 

- P == (Xq, ^II^ ^II^ ^I^ not? 

QUESTION 2. Are the union and intersection of absolutely 

determined games absolutely determined? 

QUESTION 3- How far can Propositions 10, 11, and IT be extended? 
E.g., is P strictly determined if Sj is a G^? Does the family of sets 
Sj such that P is absolutely determined coincide with any of the well 
known families of sets, e.g., the Borel sets? 

QUESTION h. Is absolute determinacy a topological invariant? 
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SIGNALING STRATEGIES IN n-PERSON GAMES’ 

G. L. Thonpson 

Behavior strategies have been used successfully to solve a number 
of games, notably Poker (see, for example, references [l], [ 3 ], and C^]). 
However, the only way to solve games without perfect recall has heretofore 
been mixed strategies. In the first part of the paper we Introduce the 
idea of signaling strategies, associated behavior strategies and coinposlte 
strategies in n-person games, and prove that any payoff attainable by means 
of mixed strategies can also be attained by means of conposite strategies. 

As a consequence any two-person game can be solved by means of composite 
strategies. 

A signaling strategy for a player is a pure strategy for that 
player restricted to that subset of his information sets which prevent him 
from having perfect recall. Then a composite strategy consists of a mlxtxire 
of pure signaling strategies, together with the assignment to each pure 
signaling strategy of a behavior strategy on the remaining relevant informa¬ 
tion sets. 

In Section 3 we give the definition of an agent of a player in an 
n-person game. Finally in Section k we discuss coalitions in n-person 
games in light of the previous parts of the paper. 

The proofs of all statements in this paper are quite trivial and 
it is felt that its contribution is conceptual in nature. Elsewhere in 
this volume (reference [ 5 ]) the ideas of this paper have been applied by 
the author to the solution of a simplified game of Bridge. 

i 1. BASIC CONCEPTS 

The description of an n-person game given by Kuhn in [2] will be 
used. The notation and definitions given there will be followed as closely 
as possible. The names of the concepts of [ 2 ] which will be used here are 
collected below, but definitions are r^eated only when the notation given 
here is different, or when comparison with new definitions is made. Def¬ 
initions of new concepts are nimibered. 

K is the game tree in which each move has at least two alterna¬ 
tives . 


^The preparation of this paper was supported by the Office of Naval Research. 
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The players are 1=0, i, n. 

is the set of moves of the 1^^ player. 

Aj is the subset of moves in K having exactly j alternatives. 
Ui Is the aggregate of informations sets U. is the aggregate 

of information sets of player 1. 

If U is contained in Pq ^ Aj then U is a one element set 
(X) and there is a probability distribution with all components positive 
on the alternatives at X. 

The above concepts are siifflclent to define a game P (except 
for the payoff which will not enter this paper in an essential manner) . 

EIEFINITION 1 . Let U be an information set for 
player i and let = (Z | Z follows some move in 
U by the alternative). Then U is a signaling 

information set for player 1 if, for some y and some 
information set V of player i, Uy /) V ^ (|) and 
V t 

The game tree of a two-person game is given in Figure 1(a). In 
this game, player i (P^) "forgets what he knew" and player 2 (P^) "for¬ 
gets what he did." is a signaling information set for player 1. Ug 

is a signaling information set for player 2. 





Let be the set of signaling information sets for player 1. 

Clearly C Prom the definition of perfect recall in [2] it follows 

that P has perfect recall for player i if and only if s/^ = (|). 

A pure strategy for player 1 is a single-valued function ir^ 
on to the positive Integers such that if U C Aj 0 Pj^ then 1^(U) < j. 

Let ■ni be the set of all 
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ESEPINITION 2. A piire signaling strategy for player 
1 Is a single-valued function tr^ on to the posi¬ 

tive Integers such that If U G and U C A . then 

< j- Let Xj_ t>e the set of all er^. (If - 
$ then 2^^ consists of the single vacuous function.) 

In Figure 1(a) there are exactly two pure signaling strategies 
for player 1, one (call It (Tj) that chooses alternative 1 at and 

the other (T^) that chooses alternative 2 at . Player 2 also has 
two pure signaling strategies. 

Since C there Is a natural mapping Y of onto Xj^j 

where V’(irj^) Is the strategy restricted to Thus Is mapped 

by Y onto that which chooses the same alternatives as does on 

the Information sets U In Then defines an equivalence relation 

on IT^ and partitions TT^ Into disjoint classes. To each such equivalence 
class corresponds exactly one pure signaling strategy <r^. Hence we denote 
these equivalence classes by the symbol . Then two pure strategies be¬ 
long to 17^ If €Lnd only If they make the ^ same choices as does for 

all U In ^ j/j_. 

If X± ^ ^ each onto the null set $ and 

((p) =71^. In this case we shall speak of the vacuous signaling strategy 
which makes no choice on any Information set and for which 11^ =TI^. 
This convention will allow us not to have to distinguish the cases^ 2)^^ 
and 2Jj_ = $ in the statements that follow. 

As In [ 2 ] a pure strategy vector 'ir defines a function p^(ir) on 
the moves X in K. A move X Is possible when playing symbolically 

X Poss If and only If there exists a ir such that > 0 . A 

move X Is Poss (cr^iir^) if and only If X Poss and ir^ ^ 

Information set U G Is Rel If and only If some X In ^ U Is 
Poss TTj^. An Information set U* G Is Rel («r^:ir^) If and only If some 

X In U' Is Poss (o-j, ;ir^) . Define ^ T^(X) = X Poss ir^), T^(U) = 

(ir^l U Poss 'iCj,) = T^(X), R^ (X) = {it^I X Poss (<r^:in)}, and 

R^ (U’) = I U* Rel (cTj^iltj^)} = ' 

^ Let be the subset of all ^ moves X of K which are pos¬ 
sible for ir^. ^ Proposition l of [ 1 ] proves that Is a tree. Then 

let K = \J^ r-rr K-*- • is also a tree. ^ Intuitively K 

1^*0- 'a ± 1 

Is the subset of ^ moves of K which can possibly occur If player 1 

uses the signaling strategy 

Lzed to as follows: 

Is In-^ 1^. We do 

not define Information sets In for the other ^ players. The order¬ 

ing and Indexing of moves and ^ assignment of chance probabilities and 
payoffs In Is the same as for the corresponding moves and plays In K. 


Let be the partition % relatlv 

If U G ^ then ^ the Information set U* = U /I 
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The trees and , shown in Figure 1 (b) and 1(c), corre¬ 
spond to the signaling ' ^ strategies and of player 1 in 
the game of Figure T(a)- It is not hard to construct the trees correspond¬ 
ing to each of the two signaling strategies of player 2 in Figure 1 (a). 

Although is not a game it is possible to speak of signaling 
information sets and ^ perfect recall for player i in , since these 
concepts depend only on the information sets for that player?- 


PROPOSITION 1 . 


Player 1 has perfect recall in K 


PROOF. If not, there exist moves X G U*, Y G V* for player 1 
with X < Y and Y G but V'. Now A V 7 ^ 0 and ^ V or 

else U was a signaling information set in K and V‘ was defined in¬ 
correctly. Hence there is a move Z in V*, so that Z G , and a move 
in U - U*, so that Z^ 4 > vith Z^ < Z. Since ^ is a tree 

(that is, every move in has^ a unique predecessor) ^ Z $ , a 

contradiction, which proves^ the proposition. 

As a corollary to Proposition 1 of [ 2 ] we have the following 
proposition. 


PROPOSITION 2. Let the information set U' con¬ 
tain the first move for player 1, X, on a play ¥ in 
the tree . Then R^(TJ*) =71^. 

A mixed strategy for player i is a probability distribu¬ 
tion on Vi which assigns the probability to 


EEPINITION 5- A mixed signaling strategy 
player 1 is a probability distribution on X 
assigns the probability to 


for 
^ which 


A mixed strategy vector fL defines a probability distribution on 


the moves X in as follows; 


Px(<r, 


'iT 


.) = oU) 




% 


where c(X) is the product of the chance moves on the path from 0 to X. 
Define X Poss Lf and only if there exists a jjl such that 

Px(<r^:/ 4 /^l) > 0; and define, for U* ^ . U* Rel if and only if 

scMoe X in U* is Poss (<^^ 2 /^ 1 ) • ^ 


DEFINITION h. 
player 1 , , 


An associated behavior strategy for 
is an assignment to each TJ* G 
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of a probability distribution b(<r^, U*,^; on the 
alternatives at U*. Thus, if U* has j alterna¬ 
tives, then b(«r^,U‘,^) >0 and = 1- 

Note that when = <[), that is, when layer 1 has perfect 
recall, this definition of an associated behavlo: strategy reduces to the 
concept of a behavior strategy as defined in [2]. 


PROPOSITION 3. A mixed strategy for player i 
defines a mixed signaling strategy j K and 

an associated behavior strategy ^ Con¬ 

versely, given a mixed signaling strategy - {q^ } 
and an associated behavior strategy » there^ is 

a mixed strategy ^ such that and 


PROOF. Given define 


"1 ir.eTr ^1 


which Is cleatrly a mixed signaling strategy. [N. B. If = $ then 

“ 1 for the (vacuous) signaling strategy In We denote this 

^ case by = 1 .] Define for D' € ?6 

(h) b(r.,p.,u',j) = X / 2 q* 

^ ^ H^eR^ (TJ') ’^l /fr^CR^(U') ^1 


If U' Rel 


ir^(U')-<f 


(c) 0 ,^ 

if U* not Rel and > 0 


(d) b(<rj^,p.^,U* is an arbitrary probability distribution if 


q =0. 


It is not hard to show that (b), (c), and (d) are probability distributions 


on the alternatives at U*• 

Conversely, given =* } and define by 

(e) b^(<ri>U',1l^(U*)) 

if ^ will belong to exactly one such). The verification of the 

proposition^ follows by routine substitution into (a) through (d). 
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I3EPINITION 5- The pair called 

a composite strategy of player 1. 

The Intuitive Interpretation of a composite strategy for the 1^^ 
player Is given as follows: The strategist for player 1 chooses, with 
probability Qg. , a signaling strategy Then the agents who control 

the Information^ sets In then make their choices as dictated by 

and the agents who control the other Information sets U In ~ make 
their selections with probabilities dictated by among the alternatives 

at TJ. Another possible interpretation of a composite strategy is given in 
Section 3 of this paper. 

The following proposition is related to Proposition 3 of [2]. 


PROPOSITION h. Let P be any game with game tree 
K and let W be any play In K. Let T^(W) = 

W Poss and let c(W) be the product of the 

chance alternatives on W, or 1 if there are no 
chance alternatives on ¥• Then for all IT = 

(lCi , ..., TTj^) and all W 


P^dt) 


c(W), If 1 G T^(¥) for 1 = 
0 , otherwise. 


n 


PROOF. By Proposition 1 of [2], ¥ Is possible for if and 

only If chooses all of the alternatives for player 1 on ¥. The 

statement then follows from the definition of p^C*":) • 

A mixed strategy ji = , ..., defines a probability dis¬ 

tribution on the plays ¥ as follows: 


( 1 ) 


••• 

= c(W) S 

ir^GTj_(¥) ,all i 

where the last step follows from Proposition k. 

Then the payoff vector H(|jl) = (H^ (^), 
to a mixed strategy vector jj- has components 

= ^all W 




) corresponding 


( 2 ) 


(¥) 


which represents the payoff to player 
A strategy vector ^ , 

In which the 1^^ component Is the conposite strategy corre¬ 
sponding to the mixed strategy for player 1, also defines a proba- 


If strategy jju Is used. 


blllty distribution on the plays ¥ of 
defines a probability distribution q 


K. To see this, note that 


on the trees K 




Then for each 
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r. <r. 

play W in [ng.te that W is the sajne as some play W in K 

and hence ^ c(W = c(W)] let Q^(W ^) = (e | e is an alternative 

for player i on W ana let U* be the Information set containing the 
last move for player i on W Then the strategy vector = 

» • • • > > • • ■ > defines a probability distribution on 

the plays ¥ ^ in as follows: 


(5) p 


w 1 ' 


c(W) 












TTfr. b(e) 

eeQ^CW 1) 


if U' Rel jjL^ 

= 0, otherwise - 

In this formula empty products are to be set equal to 1 and W is the 

(T: 

play in K which is the same as the play W ^ in Kj- • In turn formula (5) 
defines a probability distribution on the plays W of^ K by 

'"‘^1 • 

Finally, the payoff vector H(^) has conponents 

(5) “ ^all ¥ hl(W) . 

Let I = {l, n}, let SCI be any subset of I and let 

I - S be the conplementary set to S in I. Then repeated application 

of the above reasoning provides the payoff vector if the players 1 in S 

use the coirrposlte strategies “the players j In I - S use 

the mixed strategies yu,.. 

J 

i 2. A THEOREM ON COMPOSITE STRATEGIES 

The following lemma is closely related to the sufficiency part of 
the proof of Theorem 4 in [2]. 

LEMMA. Let /c = (yu.^, fL^ be a mixed strate¬ 

gy vector and let 

/^ = > ■ • • ^ > • • • > 

where is composite strategy corresponding 

to Then P^(/^) = ^ 
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PROOF. Let W be any move in K. If W contains no move of 
player 1 the lemma Is obviously true. If W contains a move for player 
1 let X be the first and Y G U the last move for player 1 on W. 

Let be any signaling strategy with >0 and such that W is con¬ 
tained in , that is, such that W = ^ W ^ for some W ^ in . 

By (5) ^ ^ 

( 6 ) = C. Me), If U e Rel , 

*= 0 , otherwise. 


where C is a constant defined in (3). Consider the quantities b(e) 
arranged in the same order as the alternatives e for player 1 on 'w 
are arranged. By Proposition 2 the denominator of the first one is exactly 
y q = q . By Proposition 1 of [ 2 ] the numerator of the first is 

^ cancelled by the denominator of the second, the numerator of the 

second cancelled by the denominator of the third, etc., \mtil only the 
numerator of the last fraction remains. The last niomerator is equal to 
^ IT-. Q-- • Then one can write ( 6 ) as 




■i) %• 


( 7 ) ^ 




f Hff • • • 'itr tr. 'i-rr 

1-1 \+1 "n ^)) i 


^ £(¥1 2 

‘^ 05 ^ 1 t.eTj(W ,all j "l 


% 


Substituting (7) into (4) gives the statement of the lemma. 

In the following theorem the sets S and I - S are defined as 
at the end of Section 1 . 


THEOREM. Let P be a game, S a subset of the 
players, and /x. = , ..., a strategy vector. 

Let y be the function defined as follows: 


T(^i) = 


If 1 G I - 3 . 


If 1 G S , 


Then if Is the strategy vector 
we have H(^) = H(^) • 
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PROOF. By repeated applications of the lemma and the remark at 
the end of Section 1. 

Intuitively this theorem means that any payoff which players can 
obtain by means of mixtures of pure strategies, the can also obtain by 
means of composite strategies. This theorem together with the fact that 
the normalized form of the game obscures signaling strategies, explains one 
reason why the normalized form of the game Is not always the best form In 
which to solve actual games. 

COROLEjARY. Any zero-sum two-person game can be 
solved by means of composite strategies. 

4 3- THE definition OP AN AGENT 

In [2] an agent Is postulated to control each Information set of 
a player. In many actual games, for example bridge, rummy, canasta, etc., 
an agent obviously controls more than one Information set (see Figure 1 of 
[ 5 ]) • To formalize this, we broaden the definition of an agent to a con¬ 
cept similar to that found In practical games. 

DEFINITION ?• By the agent partition of player 1 
(1 )> 0) we shall mean a partition of the Information 
sets of player 1 into sets 7^^, ..., , 

(ti > 1), such, that, if ^Ik is the set of ^ moves 
in the information sets contained In 2 ^^ , then the 
moves In satisfy the condition of perfect recall. 

The moves in will be called the moves of 

agent Ik meaning "the k^^ agent of player 1." 

If each P^ contains exactly one Information set then this 
definition of an agent coincides with the one given in [ 2 ]. The require¬ 
ment of perfect recall is added to the definition of an agent to capture 
the intuitive Idea that an agent is a single personality and thus avoiding 
the problem of "split personalities," (see [4] p. 55)- The agent partition 
may be given by the rules of the game as In bridge and other card games, or 
it may be up to the player himself to choose the partition as In certain 
economic situations. 

We can think of player 1 using a composite strategy 
as follows: The agents of player 1 meet before the game is played and 
decide (by means of a chance device and the probabilities given by 
which signaling strategy <r^ to use, this decision, of course, being kept 
secret from the other players in the game. The agents who control informa¬ 
tion sets relevant for cr^ then are Instructed to choose the alternative 
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dictated by oj, at those information sets. The agents controlling other 
infoimiation sets make choices as dictated by 

In [ 5 ] the author solves a simplified bridge game by means of 
composite strategies and with the use of this notion of agent. 

$ k . RBIMARKS ON n-PERSON GAME THEORY 

The formulation of the general theory of n-person zero-sum games 
is given in [ii-] p. 238 , ff. It is assumed there that if a non-empty, 
proper subset S of the set of players I forms a coalition, then they 
will "fully cooperate" with each other and become a single player. This 
could be formulated as follows: The set of agents of the composite player 
S is the union of the sets of agents of each of the players 1 in S, 
and it is assumed that these agents will cooperate as a single player. 

It is not entirely clear under what circumstances the agents of 
the players in a coalition will be allowed to cooperate with each other 
under the rules of P, nor exactly what it means for them to cooperate. 

The answer to these questions is not difficult. Suppose S= {1, •••» t} 
where 0 < t < n is a coalition of players in P. A pure strategy for the 
coalition S consists of a vector ir= (tTj, ..., rr^) taken from the 
(cartesian) product space of the pure strategy spaces for the players i 
in S; that is, ir G (IT^), where If denotes the cartesian product. 

A mixed strategy for the coalition is then an assignment of a probability 
distribution on these pure strategies. Let Mg be the set of all mixed 
strategies. ¥e shall say that a mixed strategy /c in Mg is allowabl e in 
P if it can be used by the coalition S in P. Then the first answer to 
the question posed above is: 

The agents of the players in S can fully cooper¬ 
ate as a single player (coalition) in P if and only if 

each mixed strategy ^ in Mg is allowable in P. 

From this remark it is clear that the specification of the allowable strate¬ 
gy spaces should be included in the definition of a game. 

The theorem of the last section allows us to reformulate this 
remark in a way that is easy to apply to some actual games. Let V and ^ 
be the mixed signaling strategies and associated behavior strategies 
respectively for the coalition S considered as a single player. Let us 
say that the strategies V and P are allowable in P if they can be 
used in any way by the coalition S in P. Then we can say: 

The agents of the players in S can fully cooper¬ 
ate as a single player in P if and only if each of 
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the composite strategies (V,/5) for S is allowable 
in P. 

In reference [ 5 ] there is an exajople of a simplified two-person 
bridge game with enforced coalitions in which only pure signaling strategies 
are allowable. 
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BRIDQE: AM) signaling’ 

G- L. Thompson 

Bridge has long been a favorite parlor game that has held and 
continues to hold ascendancy over most other cara games. There are a num¬ 
ber of reasons for this popularity, some of which we discuss below. 

First of all, bridge is complicated enough that many different 
situations can arise, with no set of similar situations appearing so often 
that the game becomes boring. There is always a new problem to be solved, 
a new "strategy” to be devised. Second, the payoff in bridge varies with 
such factors as doubling, vulnerability, the suit that is trump (or no 
truii^)), etc. Hence, there is the possibility that the player*s strategy 
should change with each change in payoff. Third, a player in bridge has 
Imperfect Information, both as to the cards held by his opponents and as to 
the cards held by his partner. He must therefore make his strategy depend 
on the most likely distributions of cards in the other players* hands. 

There are two important consequences of this last observation. 

The players* lack of Information about the cards in their opponents* hands 
means^ that there probably is no "best" way of playing bridge. Finally, 
the players' lack of information makes signaling ^ among the players in the 
game possible and desirable. 

It is in the subtlety and importance of signaling that bridge 
differs most characteristically from other card games, such as rummy or 
canasta, which have to some extent the phenomena noted above. Both direct 
signaling (signaling between partners), and inverted signaling (dec^tlve 
signaling or bl\iffing against opponents) occur in bridge. It is the 
presence of signaling that makes bridge particularly interesting to game 
theoreticians. 

In this note we discuss a simplified bridge model played both as 


^The preparation of this paper was siQ^orted by the Office of Naval Research. 

^Cf. Theorem T of [2]. Actually it is also necessary to verify that the 
payoff of bridge is such that mixed strategies are needed to solve the 
game. This is true for the bridge models discussed here. 

^The first discussion of signaling occurs in [6] pp. 55, 5^- The remarks 
made in [ 5 ] about games without perfect recall in general, and bridge in 
particular, are also relevant. The definition of a signaling strategy is 
given in [7]• 
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a two-person and as a four-person game, the latter being closer to ordinary 
bridge. The models discussed are similar to the play of the last two 
tricks in a hand of bridge. Good strategies^ are devisee for playing a 
single hand^ of each game. Both models exhibit the types of signaling 
described above although the signaling in the two-person game is more 
subtle than that in the four-person game. Finally, we observe that the 
four-person game cannot be directly treated by means of characteristic 
functions,^ hence a new definition of solution for that game is defined and 
used. 

In discussing bridge we shall assume that the reader is familiar 
with the technical terms of bridge (which can be found, for example, in [4], 
p. 100, ff.). Ve shall use as few of the technical concepts of game theory 
as possible (relegating them to footnotes wherever possible) so that almost 
anyone familiar with bridge can follow the discussion by using his "bridge 
sense." 


i 1 . DESCRIPTION OP THE BRIDGE MODELS TO BE USED 
The deck of cards customarily used in bridge contains 52 cards. 

28 

The number of deals possible with this deck is then approximately 5-10 • 

Since a coiiplete analysis of bridge requires that every deal be "played 
out," the amount of labor required to conpletely analyze ordinary bridge is 
clearly prohibitive.^ There are several ways of making simplified models 
of bridge, one of which we discuss here. 

In the model which we shall discuss there are four players° who 
are called North, East, South, and West. East and West together fOT»m a 
pair, East-West; similarly. North and South together form a pair, North- 
South. The rules concerning the order of deal and play, taking of tricks. 


^The mathematical justification of our method of finding the good strate¬ 
gies appears in [7]• 

^Actually, as observed in [6] p. 49, a play of bridge should be a "rubber." 
The payoff function in the bridge models considered here is not sufficiently 
close to the payoff function in bridge to make this necessary. 

^Por the definition of characteristic function see [6] p. 238 ff. The 
technical reasons why the four-person bridge model cannot be solved by 
characteristic functions are discussed in L 7 ] • 

"^Even the amount of labor required to describe the game tree of bridge is 
enormous. Chapters 1-4 of [ 1 ] are almost entirely devoted to an analysis 
of this problem. 

®The technical term for what is here called "player" is "agent," a defini¬ 
tion of which is given in [ 7 ], section 3 . The term "player" is -used 
technically to indicate what is here called a "pair, that is, a coalition 
of two "agents." 
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truiiip and no etc., are as in ordinary bridge. In'addition we make 

the following simplifying assumptions: 

yS. The number of cards in the deck is to be eight, divided into 
four su^ts with two cards in each suit. The four suits are called 
1) spad^, 2) hearts, 3) diamonds, and k) clubs, ranked in that order. The 
two cards in each suit are called ace and king with ace ranking over king. 

b. The bidding stage of bridge is omitted. Instead the declarer 

9 

and trump suit (or no trump) are determined by a random device. In par¬ 
ticular discussions it will always be assumed that South is declarer. North 
is dummy, and West leads. By Interchanging names one can arrive at any 
other situation. 

c. Scoring is to be done as follows: The payoff to the pair 
East-West is to be two units if the pair takes both tricks, one unit if the 
pair takes one trick, and zero units if the pair loses both tricks. North- 
South is to receive the negative of these amounts. It is also assumed that 
the players in each pair share equally in the payoff. 

d. We shall assume that the shuffling is perfect, that is, the 
order of cards after shuffling is Independent of the order before shuffling. 

It la probable that this particular model would have little 
Interest in itself as a game for bridge players. Note, however, the simi¬ 
larity between this model and the play of the last two tricks in ordinary 
bridge. The main difference is that the information pattern in a play is 
different from that assumed here. In particular, note that the diommy. 

North, would have laid down his cards before West leads. 

The analysis of the model given here is not trivial and, as we 
shall see, it has many of the essential properties of bridge. 

By the siinple rules of combinatorial analysis (see, for example, 
reference [ 3 ]) the number of deals is 81 /( 2 !)^ ~ 2,520 and the number of 
different hands is 81 /( 2 ! 61 )= 28 . These hands are divided as follows: 
four hands with ace and king in the same suit, twelve hands with ace and 
king in different suits, and six hands each with two aces or two kings. 

Since there is no bidding the only information given to each 
player is the knowledge of the cards in his hand plus those cards e 3 q)osed 
in the dummy’s hand and those exposed during the play. When West leads he 
has knowledge of the two cards in his hand, hence he knows that one of 
6 !/( 21 )^ = 90 deals has occured. After West leads. North, as dummy, lays 
down his hand so that South, who plays for North, knows where all but three 
of the cards are (one in West's hand and two in East's) . These can be 
distributed in three different ways, hence South knows that one of three 


^The determination of the trump suit by a random device is used in the game 
of whist, a forerunner of bridge, the rules for which are given in [k] . 
However, whist is not played in no trump. 
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deals has occiarred. At East's move. East knows where all but three of the 
cards are (one in West's and two In South's hand), hence knows that one of 
three different deals has occurred. After East plays. South knows all 
cards but two (one in West's and one in East's hand), hence knows that one 
of two deals has occurred. To Illustrate this information pattern we draw 
part of the game tree for this model of bridge (for definition of game tree 
see [53)- Readers not feunlllar with game thoery can recognize Figure 1 as 
a graphical picture of the discussion in the paragraph above. 



Figure 1 

The oval curves indicate Information sets and each one is labelled with the 
player who controls it and the number of moves which it contains. Note 
that North-South has perfect recall (see ref. [51) although East-West does 
not. 

In the following sections we shall solve this simplified bridge 
game. It may be advisable to indicate to those readers who are versed in 
game theory the theoretical basis on which this will be done. It is proved 
in [71 that any game can be solved by means of signaling strategies and 
associated behavior strategies. Only the pair East-West has any signaling 
strategies (since North-South has perfect recall). We determine all pure 
signaling strategies for East-West, eliminate some of them by domination, 
then observe that a mixture of the remaining is optimal. With respect to 
these signaling strategies we determine the good associated behavior 
strategies by means of domination. 

i 2 . SIGNALING STRATEGIES IN THE NO TRUMP CASE 


Suppose South is declarer sind the game is to be played in no 
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tmamp. It Is not hard to see that If West has an ace he* should always lead 
It since it will surely take a trick, whereas If West saves the ace there 
Is only a small chance of making It good. If then East-West agree that 
West should always lead an ace If he has one, this already constitutes a 
direct signal between East and West (It also signals Indirectly to North- 
South) , In that a king led by West always indicates that his other card Is 
also a king. 

If South has two kings, this signal will not reduce the number of 
moves In East's Information set, but In this case the Issue will be settled 
by the distribution of the aces held by North and East. In the other cases 
the number of moves In East's Information set Is reduced from three to two 
(if South has one ace) or one (If South has two aces). 

There remains only one case in which this signaling can be 
improved. It Is illustrated in Figure 2 (a). 
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Figure 2 


^2 ^ 
(b) 


If West leads the king In 2 (a), then East (knowing from-his own and 

the dummy's cards that South will take the trick) is left In a quandry as 
to which of his aces to discard. If he saves the right one he can take the 
second trick; if not, he will lose it. He does not know which king Is held 
by South, hence does not know what the last lead will be. Thus if West's 
king lead could also tell East what the other king In West's hand was, then 
East could determine which ace to save. 

The reader can easily devise ways of signaling this information; 
for example, always lead the lower r€Uiklng suit. It Is clear that, since 
there are six possible two-king hands and only four possible leads, the 
signaling cannot be perfect; that Is, there must be a certain lack of In¬ 
formation even If East-West adopts a signaling strategy. Examples of the 
four possible ways of signaling (we shall call these signals) appear In 
Figure 5 • An x corresponds to the caj?d to be led and the numbers 1 , 2 , 

5 , and h refer to the four suits. 
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Type 
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X 

X 

X 
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X 

X 

X 

X 

X 
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Figure 3 

The numbers indicating the type of signal are obtained by counting 
the number of hands with the same lead. It is easy to show that there are 
eight signals each of types 3111 and 2220 and twenty-four signals each 
of types 3210 and 2211. 

It is not hard to see that signals of type 22l1 are better than 
signals of type 2220 and signals of type 3111 are better than type 
3210. By examlng the possible situations in which signaling is relevant 
it can be shown that signals of type 2220 are just as good as type 3111, 
so that signals of type 2211 transmit the most information. It is then 
clear that only type 2211 signals should be considered for use by East- 
West. 

By a pure signaling strategy^ ® for East-West we shall mean an 
unambiguous command to West which card he shall lead for every possible 
hand. Certain elements of the signaling strategy have been discussed above 
but it is instructive to write down completely an example of a pure sig¬ 
naling strategy. The signaling strategy below refers to West's hand only. 

a) If the hand contains two aces lead the higher ranking. (The 
signal of type 3210 Illustrated in Figure 3 -) 

b) If the hand contains ace and king lead the ace. 

c) If the hand contains two kings use the type 2211 signal 
illustrated in Figure 3 - 

As observed above it is immaterial, as far as the payoff obtained 
is concerned, what the command at a) is. Moreover, the command b), as 
given, clearly dominates any other possible command at b). Also, it was 
observed above that any signal used in c) which is not of type 2211 is 
dominated by a signal of type 2211. We shall therefore ignore part a) of 
the strategy, assume that part b) of the strategy is the same for all 
strategies considered, and then the only difference in the signaling strate¬ 
gies is the choice at c) of one of the 2 k possible type 2211 signals. 


10 


The precise definition of a signaling strategy is given in [7]. 




BRIDGES ARD SIGNALING 


285 


It might seem that East-West could use one of the signals of 
type 2211 , for example the one given in Figure 3 , as a pure strategy. If 
this were an optimal strategy, East-West would not care whether or not 
North-South found out this strategy. However, Figure 2 (b) illustrates a 
case in which North-South can profit from knowing East-West*s strategy. 

The deal in which the hands of North and South in 2 (b) are interchanged is 
also a case in which North-South profits. Since 2 (a) and both variants of 
2 (b) are equally likely we see that North-South stands to profit twice as 
much as East-West from such a pure signaling strategy. 

Suppose that East-West selects at random (that is, with equal 
probability) one of the 2 h signals of type 2211 to use before each hand 
is played. Since both East and West know which signal is act-ually selected 
and used for the hand, and this knowledge is kept secret from North and 
South, we see that the desired Information is successfully signaled from 
West to East. That is, North-South cannot draw any conclusions from a king 
led by West as to the identity of the other king in West’s hand, but East 
can. This concealing of information is an exanple of inverted signaling. 

It can be seen from symmetry considerations that no other mixed signaling 
strategy dominates ttils one. 

The selection of a private signal between East and West violates 
the rule^^ of bridge stating that all \musual signals between players must 
be announced. This is equivalent to saying that only pure signaling strate¬ 
gies can be used. We therefore define a two-person bridge game to be one 
in which any mixed signaling strategy is allowed and a four-person bridge 
game one in which only pure signaling strategies are allowed. 

The above discussion shows that in the four-person game it is 
unprofitable for East-West to use a pure signaling strategy. Hence in the 
four-person game West should lead either of the two kings at random. 

4 3. GOOD STRATEGIES FOR TEE NO-TRUMP CASE 

In this section we devise good strategies for the players by 
using "bridge sense" and the results of the last section. Then we give a 
brief discussion of the reasons which make the given strategies optimal. 

Good strategies for both the two-person and the four-person 
bridge game follow. 

For West . If West's hand consists of two aces, lead arbitrarily; 
if it consists of ace and king, lead the ace; if it consists of two kings, 
use the mixed signaling strategy given in section 2 (for the four-person 


^The following sentence is found on p. 138 of [ii-]; "It is improper to 
employ an unusual convention in play without Informing the opponents of its 
significance." The penalty for violating this rule is "ostracism." 
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bridge game this part of the strategy is replaced by the phrase "if it 
consists of two kings, lead at random"). 

For North (played by South). Follow suit; or discard any worth¬ 
less card; or discard king before ace; or, if the hand consists of two aces, 
discard at random; or, if it consists of two kings, discard arbitrarily. 

For East . Follow suit; or discard any worthless card; or discard 
according to West*s signal (this phrase is eliminated In the four-person 
bridge game); or dlscaj^d king before ace; or discard arbitrarily. 

For South . Follow suit; or discard any worthless card; or discard 
king before ace; or discard arbitrarily. 

In applying the strategy the player Is to use the first applicable 
phrase. By a random play we mean that the player is to use a chance device 
which will select each of the two alternatives (assuming the cards are 
numbered in the order in which they are dealt) with probability I/2. By 
an arbitrary order of play we mean that it is immaterial which card is 
played first. A card is worthless to a player if he can determine from his 
information that it will never take a trick or, if discarded, will never 
give useful information to his opponent. For example, an ace is worthless 
to North if South has the king of the same suit and neither North nor South 
can take the first trick. 

It is clear that these are strategies, that is, that there is a 
command to cover every situation. It also is easy (although tedious) to 
check, by playing out each deal, that the parts of these strategies, ex¬ 
clusive of the signaling, arbitrary playing and random discarding, are as 
good as any other strategy and that there exist deals for which deviation 
from these strategies causes over-all loss. The use of the signaling 
strategy given was justified in the last section. We must still justify 
the random discard and arbitrary play commands. 

If North has two kings then neither will take either trick and, 
since North is dummy, both are exposed to all players. It is therefore 
clear that any strategy for discarding, pure or mixed, is good, hence the 
discard can be arbitrary. If North has two aces the situation is different 
even though both are eiqposed. It can be shown (the details are tedious) 
that if North uses a pure discard strategy of emy type then East-West can, 
by deviating from his optimal strategy and using a suitable countering pure 
signaling strategy, profit from it. However, North can safely use random 
discarding in either game. Note that this is inverted signaling. 

If East has two kings then a simple analysis of the possibilities 
shows that no discard strategy, pure or mixed, can give useful information 
to North-South. If East has two aces then an analysis of the possibilities 
shows that the only type of deal in which East does not know what to discard 
(or that it does not matter) is that shown in Figure 2 (a). For the two- 
person game this is precisely the case in which West is signaling to East. 
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Since tne signals of type 2211 are not complete there are still two 
situations for each signal in which East cannot decide what to discard. It 
is clear from Figure 2 (a) that, regardless of which discard is made, no 
useful information is imparted to North-South, hence an arbitrary discard 
is good in the two-person game. For the four-person game Figure 2 (a) again 
shows that the arbitrary discard is as good as any. 

The analysis of South's discard strategy is similar to that for 
North and shows that the arbitrary discard strategy is good. 

^ k. THE VALUES OF THE GAMES IN THE NO-TRUMP CASE 

It is evident from the symmetry of the rules, and the randomness 
of the deal and choice of declarer, that both the two-person and four- 
person games are fair, i.e., their value is zero. It is still of interest 
to calculate the expectation of the players once the declarer has been 
determined. As might be expected, having the lead is an advantage. 

If West has two aces or a complete suit then, regardless of the 
strategies employed by any of the players, East-West will ^et both tricks. 
Hence in these cases East-West has an expectation of — . 2 = 5 A- The 
other ejcpectations are more difficult to compute. The best way of doing it 
is to assume hands for West and East and then to arrange the other cards in 
the six possible ways between North and South. Compute in each case the 
probability of each hand and the amount East-West (say) can get using his 
optimal strategy. With a little experience one sees how to group similar 
situations together and thus to shorten the calculations. The two-person 
game value to East-West is 1 .^31 . Recalling the definition of the payoffs, 
this number can be Interpreted as the expected number of tricks which East- 
West can take. 

The four-person bridge game is one in which there are enforced 
coalitions and rules disallowing private signaling, hence this game cannot 
be solved by means of characteristic functions.^ However, note that the 
strategies as given in the previous section for the four-person game have 
the following intuitive characteristics: (l) each pair of players can 
assure itself of a certain minimal amount regardless of the strategy of the 
opponents; (2) no pair of players can, by its own efforts or by the 
individual effort of any player in the pair, increase its expectation with ¬ 
in the rules of the game . These criteria are discussed at length for the 
two-person zero sum case in [ 6 ], Chapter III (see particularly pp. 101-102 
and p. 159) • 

If the above criteria are accepted as a definition of the value 
of the four-person game given, we can compute its value as 1 . 428 . The 
Increase in expectation due to signaling is then .003. 
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4 5. GOOD STRATEGIES AND VALUE IN THE TRUMP CASE 


Si:5)pose that the declarer and trun^) suit are chosen at random. 
For purposes of discussion we assume that the declarer is South. Prom the 
game theoretical point of view this game is not as interesting as the 
no-trump case since there is no opportunity for the more subtle type of 
signaling previously discussed, hence there is no difference between the 
two- and four-person games. Good strategies are given below. 

For Vest . If West's hand contains both trump cards lead 
arbitrarily; if it contains the truinp ace and a non-trunp card, lead the 
trump ace; if it contains the trump king and a non-trunp card, lead the 
non-truinp card; if it contains two non-trinnp aces or two non-trump kings, 
lead at random; if it contains a non-trump ace and king, lead the ace. 

For North . Follow suit; if North's hand contains both trumps 
play arbitrarily; if it contains a trump earn and a non-trunp card, trimip 
if South cannot take the trick, otherwise play the non-trump card; finally 
if North's hand contains two non-trump cards, play any worthless card, or 
discard king before ace, or discard at random. 

For East . Follow suit; or trump or overtrump if West does not 
have the trick; or discard any worthless card; or discard king before ace; 
or discard at random. 

For South . Follow suit; or trump or over-trump if North does not 
have the trick; or discard any worthless card; or discard king before ace; 
or discard at random. 

The interpretation of these strategies is similar to the no-trump 


case. 

The value of the game is computed as for the previous case, 
assuming that South has been chosen aeclarer. Possession of the lead is 
again liaportant but not as lirportant as in the no-trump case. The value of 
the game is i.101 . 


4 6 . REMARKS 

The examples treated in this paper have several possible exten¬ 
sions and raise several questions which we list below. 

(a) Elsewhere the author will discuss these bridge models with 
the bidding stage added. 

(b) There are obvious extensions of the problem to considerations 
of models with more cards in the deck. This would increase the difficulty 
of the conputations and would bring in new types of signaling. 

(c) How do the good strategies change if the shuffling is not 

perfect? 

(d) What is the range of validity of the definition of the value 
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to the four-person game given in section 4? 

(e) (Suggested by A. W. Tucker). Find the good strategies for 
two-trick end-play situations in ordinary bridge. The necessary models can 
be obtained from the ones .used here by suitably changing the information 
patterns. 

In this paper we have dealt with the problem of private signaling 
between partners by redefining the game to be a four-person game. There 
are other possible resolutions of this difficulty. In the first place, 
the wording of the rules of bridge in Hoyle is sufficiently ambiguous that 
it might be argued that private signaling of the sort described is actually 
permissible. It is the author's opinion that, at least in the spirit in 
which the rules are usually interpreted, this is not the case and private 
signaling is unethical. Accepting this, one could still regard our bridge 
model as a two-person game if one changed its extensive form to Include 
preliminary moves at which each pair announced its pure signaling strategy, 
l.e., its leading conventions. However, if one wishes to preserve the 
extensive form of the model, then the only remaining alternative is the 
one chosen in this paper, namely, to redefine the game as a four-person 
game with enforced coalitions. As observed above, this requires a new 
concept of solution in a four-person game. 
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ST3MS OP POSITIONAL GAMES’ 

John Milnor 

Many common games, such as chess and checkers, exhibit a struc¬ 
ture in addition to that which is necessary to define their game theoretic 
properties. By a position in such a game will be meant merely the physical 
setup of the board without any specification as to which player is to 
move.^ In these games a set of possible moves is defined at each position 
for each of the players, even though only one of them will actually be able 
to move from this position in any particular play of the game. In this 
paper an operation of addition will be defined and studied for games having 
this structure. 

The games to be considered may be described as follows. There is 
a finite set of possible positions P and a startlnp; position p^ G P. 

For each p G P and each player 1 « 1, 2 there is a set of possible 
moves Mj^(p) C P. These are to satisfy the following finiteness condition. 
Every chain p^ , ••• of positions such that 

Pj^^ G M^(Pj) u M^CPj) , j = 1, 2, 3, ... 

must terminate. In particular a pass p G M^^Cp) is never possible. For 
each p such that one player has no possible move, that is such that 

(p) or MgCp) l3 the vacuous set (j), the other player shall also have 
no move^ and the payoff functions k^ (p) = -kgCp) shall be defined. The 
players are to move alternately starting at p^ \mtll one is unable to 


^The preparation of this paper was sponsored (in part) by The RAM) 
Coi*poratlon. 

^Thls is not quite precise. Chess, for example, is complicated by the rule 
that if a "configuration,” in the sense of the physical setup of the board 
together with the player whose turn it is to move, is repeated three times 
then the game is a draw. In order to allow for this it is necessary to 
define a position as the setup of the board together with the set of con¬ 
figurations which have occurred since the last irreversible move. 

^Thls requirement is not too strong since, if it does not hold, it is only 
necessary to add some fictitious moves and positions to the game in order 
to satisfy it. For example in chess the move of taking the pieces off 
the board when the game is stalemated could be added. 
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move, and then each is to collect his payoff. The information is perfect 
and there are no chance moves. 

For each player i and position p, let Vj^(p) denote the 
value of the game for 1 if it is l*s turn to move at position p. It 
is characterized by the equations 


Vj^(p) = k^(p) for Mj^(p) = (|> 

v.(p) = Max (-V, .(p,)) for M.(p) ^ $ • 
^ P,GM^(P) ^ ^ 

In particular we have the inequalities 


( 1 ) 


(p) > -VgCPj) for p, e M,(p) 
V 2 (p) > -Vi(Pi) for p, G MgCp) . 


In case the equality holds in one of these inequalities, the move p^ is 
called an optimal move . By the value of a game G will be meant 
v^(G) where p^ is the starting position of G. 

By the incentive I(p) wlriich a player has to move at position p 
will be meant the amount he woula gain by moving rather than passing if he 
were given this choice. Thus if player 1 moves at position p and both 
players play optimally the payoff to i will be v^(p). If player 1 were to 
pass, however, his payoff would be -V 2 (p) • The amount he gains by moving 
rather than letting 2 have the lirst move is therefore given by the 
symmetrical expression 


(2) I(p) = V, (p) + Vg(p) . 

By the sum of a game G and a game G' will be meant the game 
in which a player has the choice of moving in G and passing in G* or 
passing in G and moving in G* on each move, and in which he tries to 
maximize the sum of his payoffs.^ Thus a position p + p' in G + G* is 
a pair of positions (p,p') t P x P* and the possible moves are 

M^(p + p*) = M^(p) X p* u p X Mj^(p*) . 


K 

More generally the payoff in the sum game could be defined by 

+ pM = f^{k^{p), (p*)) 

where f- is any function which is monotone in each variable. General¬ 
ized sums of three or more games could be defined Ir the same way. 
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Note that game addition Is an associative, commutative operation. 

In order to get some Information about + P‘) 

I(p + P*) It Is necessary to construct specific strategies for G + G* 

In terms of known strategies for G and G*. Thus In order to get an 
upper bound for v^(p + p*) It Is necessary to construct a strategy for 
player 2. Define such a strategy by the following rules: 

a) Always make a move which Is optimal In G or G* - 

b) If possible move In the game In which player 1 has just 

moved.^ 

If player 1 Is to move at position p + p* and 2 follows these 
males, there are two cases. If 2 Is always able to follow rule b), then, 
considering only those moves which were made In game G, the players have 
moved alternately. Since 1 has moved first and 2 has made optimal moves, 
the payoff to l In game G Is at most v^ (p) . Similarly his payoff In 

G* Is at most v^(p*)- Therefore In this case 

(p + P') < (p) + v^(p') . 

It may happen, however, thac at some point 2 Is unable to follow rule b) 
since the game In which i has just played Is over. In this case, con¬ 
sidering only the moves made In the other game from the starting position 
p or p*, player 2 Is forced either to move twice In a row, or to make 
the first move. If this happens at position p^ then It will be shown 

that the payoff to player 2 will be augmented by I(p^) and the payoff to 

player l will be booinded by v^ (p) + v^(p*) - Kp^) • Suppose, for example, 
that 1 has finished the game G* by making the move p^ and that It Is 
2’s turn to move at p^ P^ • Since the players have moven alternately In 
both games, and since player 2 has movea optimally we have (by repeated 
application of the Inequalities (1) for player 1 and the corresponding 
equalities for player 2) 


v^(p^) < v^(p) 
v-j (P-i*) < (p») . 

Since the game G* Is over, the payoff to 1 In G* Is k^(p^) = v^ (p^) . 
Since the player 2 will make optimal moves In G the payoff to 1 In G 
will be at most -V 2 (p^)• Therefore 


^The following rule would also be sufficient 

b') If possible move In the game In which the Incentive Is 

highest. 
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V, (p + P') 1 = -KPi) + V, (p,) + V, (p,') 

< -I(p^) + V,(p) + v^(p') . 


If we define 


D= Max (0, -I(p,), -Kpi)) . 
p,GP, p|€P' 


It has thus been proved that 

v^Cp + p') < v^(p) 
Letting player 1 use the same strategy, 
Vi(p) - VgCp') - D 
- VgCp) + (p*) - D 


+ V, (p') + D • 
it follows that 

^ < Vi (p + p') - 


In many games the incentive can be negative and D is therefore 
not zero. In chess for example the phenomenon of being forced to move when 
one would like to pass is called Zugzwang. The preceding inequalities are 
extremely weak for such games, however, so we will consider only games in 
which I(p) > 0 for all p G P, henceforth . For such games D = o and 
therefore we have the following statement which will be basic for the 
remainder of this paper. 

Vi(p) - V2(P') 

(5) > < v,(p + p') < V, (p) + V, (p') . 

- VgCp) + V,(p') J 


In particular, substituting in equation (2) we have the "metric" inequality 


(*») IKp) - i(p')l < l(p + p') 1 Kp) + I(p’) • 


Since the left side is non-negative, it follows that in forming sums of 


°Por the generalized sum of footnote 4 we would have by the same method 
fiCv, (p), -VoCp’)) 

(3') ' ' ^ >- < v,(p + p') < f,(v.(p), v,(p')) • 

f,(-V 2 (p), v,{p*)) J - ' - 1 1 1 

Both of these formula remain true if the indices 1 and 2 are interchanged. 
Similar IneqToalltles hold for generalized sums of three or more games. 
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games we preserve the condition that I be non-negative. 

Define two games G and G* to be equivalent G If for 

every G* * the condition 

v^(G + G**) = v^(G» + G**) 

is satisfied, where all three games are to satisfy the condition that I{p) 
be non-negative for all p G P. It is clear that this is an equivalence 
relation and that sums of equivalent games are equivalent. 

Two objections may be raised to this definition of game equiva¬ 
lence. First, it is not symmetric between the two players. Second, no 
effective procedure for determining whether two games are equivalent is 
apparent. Both of these objections will be removed by Theorem 1 . 

Let -G denote the game G with players interchanged so that 
v^(-G) = V 2 (G) and I(-G) = 1(G). The position corresponding to p in 
-G will be denoted by -p. Consider the game G + (-G), which may be 
abbreviated to G - G. Since the player who moves second can do at least 
as well as the first player by symmetrizing his moves, it follows that 
v^ (G - G), VgCG - Cj) < 0. Since I(G ~ 0) yo, it follows that 

(5) (G . G) = VgCG - G) « 0 . 

THEOREM 1 . The following three conditions are 
equivalent. 

a) G-^G’. 

b) V 2 (G + G»*) = VgCG* + G**) for all G»*. 

c) v^(G - G*) = v^CG - G*) =0. 

It will first be shown that v^(G + G*') < Vj^(G* + G**) for all 
G* ' if and only if v^(G - G') <0. Setting G'* = -G* in the first of 
these two inequalities we have 

v^(G - GO < v^(G* - GO = 0 . 

Conversely it follows by (3) and (5) that if v^(G - GO < 0 then 
v^(G + G*0 = v^(G + G*0 - - GO 

< v^((G + G*0 + (G* - GO) - Vj ((G* + G*0 + (G - GO) 

^ v^(G* + G*0 + v^(G - GO < v^{G* + G*0 • 

The theorem follows from this assertion together with the 
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observation that - G*) - - G) . For example, if a) holds then 

v^(G - G*) < 0 and v^(G* - G) = VgCG - G*) <0. Since I(G - G') > o 
it follows that c) holds. 

A nontrivial example of two games which are equivalent is given 
by Figure 1 . In this diagram the positions are indicated by vertices, 
while the possible moves are indicated by arrows which are solid for 
player l and dotted for player 2. The payoff to player 1 is given. 



It follows from Theorem l that a game G is equivalent to the 
game zero (the game with one position ana payoff zero) if ana only if 

v^(G) = V 2 (G) = 0 . 

From equation (5) it follows that G - G ^o, so that -G is indeed"^u,r 
Inverse to G- The equivalence classes of games therefore form an abelian 
group under addition. 

Several subgroups of this group are of interest. The symmetric 
games — games in which the role of the players is interchangeable — are 
characterized by the equation G ~G or G + G ^ o. In other words they 
form the subgroup of elements of order 2. 

Another subgroup consists of those games which satisfy 1(G) = 0. 
The fact that these form a subgroup follows from the inequalities (4) and 
the equation 1(G) = K-G)• It also follows from (4) that the factor group 
of games modulo games with incentive zero is a metric group under the 
metric I. The subgroup itself is isomorphic to the real numbers under 
addition, the Isomoiphism being provided by v^(G) or V 2 (G). Suppose, 
for exairple, that the games G and G* satisfy 1(G) = I(G*) = 0 and 
v^(G) = v^(G*)- Then V 2 (G) = V 2 (G*) = -v^ (G) and 
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0 = v^(G) - v^(G*) = v^(G) - VgC-G*) < v^(G - G») 

< v^(G) + v^(-G*) = v^(G) + V 2 (G*) - 0 . 

Therefore v^(G - G*) =0 and similarly VgCG - G*) =0, which 
implies that G'^G*- In particular G and G’ are equivalent to the 
game with only one position in which 2 pays 1 the amount (G) - 

The fundamental problem involved in the study of sums of games 
is that of describing optimal strategies for the sum of two or more games 
in terras of information about the individual games. Some information about 
this question will be given by Theorem 2, but a precise answer seems fairly 
difficult. 

It will frequently happen that the optimal moves in the sum of 
two games are not optimal in the individual games. An exanple of this is 
given in Figure 2. 



Figure 2 

THEOREM 2. If the move p^ G M^ (p) is optimal 
for player 1 at some position p + p*, then 

Vi(p) < V^(p^) 


and 


V2(Pi) < VgCp) . 

Furthermore the position p* must satisfy 

V^(P) + VgCP^) ^ I(P') < V, (pp + V2(p) . 
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These ineqxmllties are obtained by combining the equation 
v^(p + p*) = + P*) which states that p^ + p* Is an optimal move 

for 1 at the position p + p*, with the Inequalities (3) as applied to 
(p + p*) and V 2 (p^ + p*)- 

In order to gain some Insight Into the meaning of these In¬ 
equalities, several new definitions will be made. 

The loss function r^Cp^p) = v^(p) + ) measures the 

amount by which the move p^ G fails to be optimal. Its fundamental 

property, which follows from ( 1 ) Is r^^Cp^/p) ^ 0 where equality holds If 

and only If the move Is optimal. 

The gain function gj^(p-j/p) ^ 3 -i^P^ ” ^ 3 -i^^l^ measures the 

amount by which the move G Mj^(p) Is better than a pass. Its funda¬ 

mental property Is 

gi(Pi/p) < I(P) 

where equality holds only for optimal moves. This follows from the 
equation 


gi(Pi/p) = i(p) - ^^(Pi/p) • 

A move p^ + p* G WLj^(p + p*) will be called sente if 

Kp^) > KP*) • 

A sente move tends to force the opponent to reply in the same game. The 
quantity 


s^Cp^^p*) -Max ( 0 , I(p*) - I(p^)) 

measures the amount by which the move p-j +p’ GM^^Cp + p*) fails to be 
sente. It is a non-negative quantity which vanishes only for sente moves. 
Using these three quantities we may rewrite Theorem 2 as follows. 

THEOREM 2 '. If the move p^ + p» G M^ (p + p') is 
optimal then the following inequalities hold 

ri(Pl/p) < Min (I(p^), I(p*)) 

8 ,(P, ,P') < g,(Pi/P) • 


^Prom the Japanese game Go. Pronounced sen-teh. 
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Roughly speaking, the first inequality says that a move which is 
non-optlmal in G can be optimal in G + G* only if it leads to a posi¬ 
tion of high incentive and if the game G* has high Incentive. Apparently 
it is desirable to place the opponent in a position in which both games 
have high incentive, and it may be worth the sacrifice of a move which is 
not optimal in G in order to achieve this end. 

The second inequality says that a non-sente move can be optimal 
in G + G* only if it is much better than a pass, and even a sente move 
cannot be worse than a pass. 

The following inequalities describe the behavior of the loss and 
gain functions under the formation of sums of games. They are immediate 
consequences of (3) which are included only for completeness, since they 
will not be used in the sequel. 


r^(p/p) - Min (I(p^), I(pO) 
ri(Pl/p) + 3^(p,,p') - I(p) 


< 1*1 (P, + P’/P + P') <1*1 (Pi/P) + I(P') 


gl(Pi/p) - I(P') 
gl(Pl/p) - I(P) 


< gi(Pi + P'/P + P’) 1 


gl(Pl/p) + I(P') 
gi(P,/p) + KPi) 


The following theorem gives a characterization of those moves in 
a game which can be optimal in some sum game. 


THEOREM 3. The following three conditions are 
equivalent. 

a) The move p^ - p G M^ (p - p) is optimal. 

b) The move p^ + p* G M^ (p + p') is optimal for 
some p *. 

c) The move p^ + p** G M^(p + p**) satisfies 
gl (Pl + p"/p + P") ^0 for all p*' . 

Setting p* = -p we have that a) Iniplles b) . If p^ + p* is 
optimal at p + p» then (p^ h p* *) + (p* - P* *) is optimal at 
(p + p**) + (p* - p*')- Since p^ + p** is an optimal move in some sum 
game, it follows by Theorem 2‘ that it has non-negative gain. Therefore b) 
implies c) . If p’* = -p then from c) we have 

0 <. Si (Pi - p/p - p) = VgCp - p) - VgCp^ - P) = - VgCp, - p) < V, (p - p) = 0 

which shows that p^ - p is optimal at p - p, and completes the proof. 
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The following may be described as a converse to (5) • 

THEOREM h . If player 1 is to move at p + p *, 
and if he makes the first move in game G, then for 
any play of G + G* the payoff k^ of this game will 
satisfy 

V,(p) + V,(p’) - Xr, - Xs, <1^1 < - VgCp’) + 

where the first two summations are taken over all moves 
made by 1 in this particular play, and the last two 
over all moves made by 2. 

Thus if player l can always make moves which are optimal in G 
or G* and sente, he will achieve the upper bound of v^ (p) + v^(p») for 
his payoff. If 2 can always make optimal sente moves, he will achieve the 
lower bound of v^ (p) - V 2 (p») (or -VgCp) + v^(p') if the first move Is 
made in G*)- Since these two outcomes are usually incoirpatible, it follows 
that it is frequently impossible to make moves in G + G' which are both 
optimal in G or G' and sente. 

Since proofs of these two inequalities are similar, only the 
first will be carried out. Suppose that player l makes the move 
p^ + p* e M^(p + p*) and 2 replies with the move Pg + P 2 > "where either 
p^ = Pg or p* = P 2 - III the first case we have 

Pi = Pa’ VgCp') > -V,(p^), 
v,{p2) + v^(p^) = v^(p,) + v^(p') > v^(p,) - VgCp') = 
v^Cp) + v,(p') - r^(p^/p) - (I{p') - Kp^)) • 

In the other case 


P'=P^, VgCp,) > -Vi (pg), 

V, (Pg) + V, (p^) = V, (Pg) + v^(p') > -Vg(p^) + v^(p') = 

V, (p) + v^(p') - r,(p,/p) - 0 . 


®The condition that I be non-negative Is not required for this theorem. 
Which depends only on (l) . 
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Combining these two inequalities we have 

V, (Pg) + V, (Pp > V, (p) + V, (p') - r, (p,/p) - s,(p,,p') . 

Taking the corresponding inequalities for each move by player 1 in the play 
of the game, and combining them we have the required inequality. (If 
player 2 follows the strategies a) and b*) of footnote 5, it is easily 
shown that equality holds in this expression. This provides an alternative 
proof of (5)•) 


J. W. Milnor 


Princeton University and 
The RAND Corporation 




Part IV 


GSNSRAXi n—PURS ON GAMEIS 


A one-person game can be converted easily into a maximization 
problem and hence is conceptually quite simple. The direct opposition of 
Interests in a zero-sum two-person game leads to the minimax game-value, 
which is convincing both in its Interpretation and in its mathematical 
rigor. But, once the game theorist leaves these well-explored areas for 
the uncharted territory of games with more than two participants or no 
constant-sum restriction, he has few bearings to guide him through the 
bewildering maze of paths open to him. The authors of the papers in Part 
IV attempt to throw light on known problems and to lead the reader into new 
approaches to the theory of general n-person games. 

Is it possible to appraise the eqiiitles of the participants in an 
arbitrary n-person game? (See Study 2k, Preface, Problem 10 .) In PAPER 17 
L. S. Shapley proposes a set of "values" which may be regarded as an 
a nrlori. evaluation of the players* positions (or seats) in a game. Ignoring 
totally any social structure or standard of behavior. His result can be 
intei*preted by imagining the random formation of a coalition of all of the 
players, starting with a single member and adding one player at a time. 

Each player is then assigned the advantage accruing to the coalition at the 
time of his admission. In this process of computing the expected value for 
an individual player all coalition formations are considered as equally 
likely. Shapley shows that there is just one evaluation which is additive 
with respect to the combination of Independent games and which is such that 

1>l + I’s + ••• + fn = A ' 

where (|)j^ denotes the value assigned to player i = 1 , 2 , ..., n, and A 
the amount which the entire set of n players can obtain by cooperating. 

Still outstanding is the question, whether every n-person game has 
a solution in the sense of von Neumann and Morgens tern. (See Study 2k, 
Preface, Problem 8 .) However, Papers l 8 , 19 and 20 introduce new classes 


303 



GENERAL n-PERSON GAMES 


30k 

of n-person games for which solutions are obtained and employ methods which 
hold promise for further advajice- Papers 18 axid 19 deal with a class of 
games, termed "(n, k)-games,” that generalize the "direct majority game” 
of von Neumann and Morgens tern (see Theory of Games and Economic Behavior, 
p- ^ 51 ), while Paper 20 develops "quota games," a class of games that 
includes all constant-sum fo\ir-person games. 

The (n, k)-game. Introduced by R. Bott in PAPER 18 , is an 
n-person game in which any coalition of k or more players, for any fixed 
k > n/2, wins one unit from each of its opponents and any smaller coali¬ 
tion is totally defeated. Here a coalition of exactly n-k+1 players is 
a "blocking coalition," since it is just large enough to keep its comple¬ 
ment from winning. Bott shows that the winning coalitions in a symmetric 
solution are composed of a number of blocking coalitions and that the 
members of any one blocking coalition within a winning coalition share 
equally in an luputatlon of the solution. Symmetric solutions are thus 
uniquely characterized. Dropping symmetry, D. B. Gillies exhibits in 
PAPER 19 a surprising variety of other solutions of (n, k)-games, all 
derived from Bott*s symmetric solutions. Gillies* solutions are obtained 
by several methods which may carry over to a more general context: (1) by 
the addition of "bargaining curves” (Theory of (3ames and Economic Behavior, 
p. 501 ), ( 2 ) by inflation to larger games (ibid., p. 598), ( 3 ) by 
"discrimination" (ibid., pp. 288 - 289 ) in which the non-dlscriminated 
players divide their take according to any solution to a smaller game, or 
(^) by partitioning the players into fixed subsets, assigning the spoils 
arbitrarily (i.e. in all admissible ways in one solution) among these 
subsets, and then dividing the spoils in any one subset according to the 
symmetric solution to a smaller game the players think they are playing. 

Contrary to the (n, k)-games whose majority nature is readily 
described by verbal rules, the "quota games" introduced by L. S. Shapley in 
PAPER 20 stem from technical properties of the characteristic function v 
of von Neumann and Morgens tern. An n-person game is called a "quota game" 
if the amount A which the whole set of n players obtains by cooperating 
can be split among the n players 

A = + ... + 


so that 


v^j for all 1, j (i ^ j) , 

where v^j denotes the amount that the pair of distinct players i and j 
can obtain by cooperaring. Shapley obtains families of solutions for the 
entire class of quota games, a class that contains some three-person games. 
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all constant-sijin four-person games, and a sizeable swath of all games with 
more than four players. In a typical Imputation In one of these solutions, 
all but two or three of the players receive their "quotas” 

In PAPER 21 H. Ralffa considers the challenging conceptual prob¬ 
lem of how one should choose an Imputation from among the startlingly 
profuse solution sets of von Neumann arid Morgenstern or from the equally 
abundant equilibrium points of Nash. He proposes "arbitration conventions" 
as a solution for generalized two-person games, i.e., two-person games in 
which the restrictions to a transferable utility and a common unit of 
measure have been dropped. To this end he represents the payoffs x and 
y to players I and II, which result from a pair of mixed strategies for 
the two players, as a point (x,y) In a Euclidean plane. The set R* of 
all payoff points (x,y) is extended to the minimal closed convex set R 

■It 

containing R . Reflecting the players* preferences in payoffs, a partial 
ordering of points is made; 

(x, ,y, )-< (Xg.yg) if < X2, y-i < Yg > X^ + y^ < Xg + yg J 

-N-N- -X-N- 

Which leads to the subset of points of R which are maximal with 

respect to the partial ordering. In terms of this graphical representa¬ 
tion, an "arbitration convention" Is defined as a mapping T: R —•> 
that satisfies certain "natural" conditions. The mapping T, coupled with 
the initial mapping of pairs of mixed strategies into payoff points (x,y), 
assigns to each pair of mixed strategies for the two players a preferred 
outcome in , thus transforming the given game into a new game. 

Ralffa*s principal theorem asserts that saddlepoints always exist in this 
transformed game. Several examples of arbitration schemes especially 
suited to certain social structures are examined. 


H. W. K. 
A. W. T. 




A VALUE FOR n-PER30N GAMES’ 

L. S. Shapley 

4 1 . INTRODUCTION 

At the foiindatlon of the theory of games is the ass-umptlon that 
the players of a game can evaluate, in their utility scales, every "pros¬ 
pect" that might arise as a result of a play. In attempting to apply the 
theory to any field, one would normally expect to be permitted to include, 
in the class of "prospects," the prospect of having to play a game. The 
possibility of evaluating games is therefore of critical importance. So 
long as the theory is unable to assign values to the games typically found 
in application, only relatively simple situations — where games do not 
depend on other games — will be susceptible to analysis and solution. 

In the finite theory of von Neimiann and Morgenstern^ difficulty 
in evaluation persists for the "essential" games, and for only those. In 
this note we deduce a value for the "essential" case and examine a number 
of its elementary properties. ¥e proceed from a set of three axioms, 
having simple intuitive interpretations, which suffice to determine the 
value uniquely. 

Our present work, though mathematically self-contained, is fomded 
conceptually on the von Neumann-Mor gens tern theory -up to their Introduction 
of characteristic functions. We thereby inherit certain Important Tinder- 
lying assumptions: (a) that utility is objective and transferable; 

(b) that games are cooperative affairs; (c) that games, granting (a) and 
(b), are adequately represented by their characteristic functions. However, 
we are not committed to the assimiptlons regarding rational behavior embodied 
in the von‘Neumann-Mor gens tern notion of "solution." 

We shall think of a "game" as a set of rules with specified 
players in the playing positions. The rules alone describe what we shall 


^The preparation of this paper was sponsored (in part) by the RAND 
Corporation. 

^Reference [3] at the end of this paper. Examples of infinite games with¬ 
out values may be found in [2], pp. 58-59, and in [l], p. 110. See also 
Karlin [2], pp. 152-155. 
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call an "abstract game.” Abstract games are played by roles — such as 
"dealer," or "visiting team" — rather than by players external to the 
game. The theory of games deals mainly with abstract games.^ The dis¬ 
tinction will be useful in enabling us to state in a precise way that the 
value of a "game" depends only on its abstract properties. (Axiom 1 below) . 

^ 2. EEFINITIONS 

Let U denote the universe of players, and aefine a game to be 
any superadditive set-function v from the subsets of U to the real 
numbers, thus: 

(1) v(0) = 0 , 

(2) v(S) > v(S A T) + v(S - T) (all S, T C U) . 

A carrier of v is any set N C U with 

(3) v(S) = v(N A S) (all S C U) . 

Any superset of a carrier of v is again a carrier of v. The use of 

carriers obviates the usual classification of games according to the num¬ 
ber of players. The players outside any carrier have no direct influence 
on the play since they contribute nothing to any coalition. We shall 
restrict our attention to games which possess finite carriers. 

The sum ("si:perpositlon") of two games is again a game. Intui¬ 
tively it is the game obtained when two games, with Ind^endent rules but 
possibly overlapping sets of players, are regarded as one. If the games 
happen to possess disjunct carriers, then their sum is their "composition."^ 
Let Tr(U) denote the set of permutations of U — that is, the 

one to one mappings of U onto Itself. If tr G THU), then, writing TTS 

for the image of S under IT, we may define the function lTv by 

(^^) irv(trS) = v(S) (all S C U) . 

If V is a game, then the class of games rrv, TT t TRU) , may be regarded 
as the "abstract game" corresponding to v. Unlike composition, the opera¬ 
tion of addition of games can not be extended to abstract games. 


■Z 

^An exception is found in the matter of symmetrlzation (see for example [2], 
pp. 81 - 83 ), in which the players must be distinguished from their roles. 

^See [3], §4 26 . 7.2 and . 3 . 
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By the value (|)[vl of the game v we shall mean a fimctlon 
which associates with each 1 in U a real number and which 

satisfies the conditions of the following axioms. The value will thus 
provide an additive set~function (an inessential game ) v : 

( 5 ) V(S) = Xs s C U) , 

to take the place of the superadditive function v. 

AXIOM 1 . For each ir in TTdJ), 

♦^iETTv] = . 

AXIOM 2. For each carrier N of v, 

Sn ^i^^^ • 

AXIOM 5 . For any two games v and w, 

(|)[v + w] = 0[v] + (|)[w] . 

COMMENTS. The first axiom ("symmetry") states that the value is 
essentially a property of the abstract game. The second axiom ("efficien¬ 
cy") states that the value represents a distribution of the full yield of 
the game. This excludes, for example, the evaluation (|)^[v] = v((l)), in 
which each player pessimistically assumes that the rest will all cooperate 
against him. The third axiom ("law of aggregation") states that when two 
independent games are combined, their values must be added player by player 
This is a prime requisite for any evaluation scheme designed to be applied 
eventually to systems of interd ependent games. 

It is remarkable that no further conditions are required to 
determine the value uniquely.^ 

^ 3. DETERMINATION OF THE VALUE FUNCTION 

LEMMA 1 . If N is a finite carrier of v, then, 
for i t N, 


<|)j^[v] = 0 . 


^Three further properties of the value which might suggest themselves as 
suitable axioms will be proved as Lemma 1 and Corollaries 1 and 5 below. 
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PROOF- Take i t N- Both N and N u (1) are carriers of v; 
and v(N) = v(N u (1))- Hence (p^[v] = 0 hy Axiom 2, as was to he shown- 
We first consider certain symmetric games- For any R C U, R ^ 0 
define Vj^: 


(6) 


Vjj(S) = 


1 If S 2 R , 

0 If S ^ R . 


The function cvj, la a game, for any non-negative c, and R la a 
carrier. 

In what follows, we shall use r, s, n, --- for the numbers of 
elements in R, S, N, ... respectively. 

lemma 2. For c > 0 , 0 < r < «, we have 



/ c/r 

(flEcVg] = 3 

if 

1 G R , 


1 0 

if 

1 t R . 

PROOF. 

Take i and j in R, 

and 

choose IT 6 TRU) so that 

and TTi = 

j. Then we have uVj^ = 

^R' 

and. hence, by Axiom 1, 


<l>j[CVjj] = ll>i[CVj^] 



By Axiom 2, 

c = cVjj(R) = SjGR = r$i[cvg] , 

for any 1 G R - This, with Lemma 1, completes the proof. 

lemma 3.^ Any game with finite carrier is a 
linear combination of symmetric games Vj^: 

(7) ^ = Srch °R^^^^R ’ 

R^O 

N being any finite carrier of v. The coefficients 
are Independent of N, and are given by 


^The use of this lemma was suggested by H- Rogers. 
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(8) Cj^(v) =StcR (0 < r < «,) . 

PROOF. We must verify that 

(9) v(S) = Cjj(v)Vj^(S) 

1^0 

holds for all S C U, and for any finite carrier N of v. If S C W, 
then (9) reduces, by (6) and (8), to 

v(s) -X^s'^Tsi (-""Mm 

The expression in brackets vanishes except for s = t, so we are left with 
the identity v(S) = v(S) . In general we have, by (3), 

v(S) = v(N n S) = Srcn a S) = Srcr Cj^(v)Vj^(S) . 

This completes the proof. 

REMARK. It is easily shown that Cj^(v) = 0 if R is not 
contained in every carrier of v. 

An immediate corollary to Axiom 3 is that (l)[v-w] = (l)[v] - <|)[w] 
if V, w, and v - w are all games. We can therefore apply Lemma 2 to 
the representation of Lemma 3 and obtain the formula: 

( 10 ) il>iCv] = Xrcn (all 1 e N) . 

R3i 

Inserting (8) and simplifying the result gives us 


( 11 ) 


.[v] =X 


SCN 
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v(S) - SscN v(S) 

3^1 

(all 1 G N) 


Introducing the quantities 


( 12 ) 


ll'j^(s) = (s-1) !(n-s) !/n! , 


we now assert: 


THEOREM. A unique value fimction (|) exists 
satisfying Axioms 1-5, for games with finite carriers; 
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it is given by the foi*mula 

( 15 ) <l>^Cv] ir^(s)(v(S) - v(S-(i))] (all i G U) , 

where N is any finite carrier of v. 

PROOF. (13) follows from (11), (12), and Lemma 1- We note that 
(15), like (10), does not depend on the particular finite carrier N; the 
(j) of the theorem is therefore well defined. By its derivation it is 
clearly the only value function which could satisfy the axioms. That it 
does in fact satisfy the axioms is easily verified with the aid of Lemma 3- 

J k. ELEMENTARY PROPERTIES OP THE VALUE 

COROLLARY 1 . We have 

(14) c|)^[v] > v((i)) (all 1 G U) , 

with equality if and only if 1 is a dummy -- l.e., 
if and only if 

( 15 ) v(S) = v(S - (1)) + v((l)) (all S 9 1) , 

PROOF. For any 1 G U we may take N ? i and obtain, by (2), 

S31 

With equality if and only if (15), since none of the y^(s) vanishes. The 
proof is completed by noting that 

(16) ^SCH =Ss^1 is-]) =^s=1 H = ’ • 

S9i 

Only in this corollary have our results depended on the super- 
additive nature of the functions v. 

COROLLARY 2. If v is decomposable -- l.e., if 
games w^ ^ ^, w^^^, ..., w^^^ having pairwise disjunct 
carriers N^^^..., exist such that 


v-2^,»« 
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— then, for each k=l, 2 , 

(l>l[v] = (all 1 e . 

PROOF. By Axiom 3. 

COROLLARY 3- If v and w are strategically 
equivalent — l.e.. If 


(17) ¥ = cv + a , 

where c Is a positive constant and a an additive 
set-function on U with finite carrier'^ — then 

$^[w] = c(l)j^[v] + a((l)) (all 1 G U) . 

PROOF. By Axiom 3, Corollary 1 applied to the Inessential game 
a, and the fact that (13) Is linear and homogeneous In v. 

COROLLARY 4. If v Is constant-sum — l.e., If 

(18) v(S) + v(U - S) = v(U) (all S C U) , 

— then Its value Is given by the formula: 

(19) = 2[Ss(^U )rj^(s)v(S) ] - v(N) (all 1 6 N) • 

Sli 

where N Is any finite carrier of v. 

PROOF. ¥e have, for 1 G N, 

^^[V] = SscN ‘'n^s)v(S) -XtcN 

S9l T^i 

= ^SCN *fn(s)v(S) - SscN ^ ^• 

Sli S¥l 

But y^(n-s+l) = hence (18) follows with the aid of (l6). 


'^Thls Is McKlnsey*s "S-equivalence" (see [ 2 ], p. 120 ), wider than the 
"strat^lc equivalence" of von Neumann and Morgenstern ([5], J 27 . 1 ). 



3514 


SHAPIiEY 


^ 5 . EXAMPLES 

If N Is a finite carrier of v, let A denote the set of 
n-vectors satisfying 

( ^N^i “ , 

V \ v((i)) (all 1 G N) . 

If V is inessential A is a single point; otherwise A is a regular 
simplex of dimension n - 1. The value of v may be regarded as a point 
$ in A, by Axiom 2 and Corollary 1 . Denote the centroid of A by e: 

e^ = v((i)) [v(N) - Xjeu • 

EXAMPLE 1 . For two-person games, three-person constant-sum games, 
and inessential games, we have 

( 20 ) $ = 9 . 

The same holds for arbitrary symmetric games — 1.e., games which are 
invariant under a transitive group of permutations of N — and, most 
generally, games strategically equivalent to them. These results are 
demanded by symmetry, and do not depend on Axiom 5- 

EXAMPLE 2. For general three-person games the positions taken 
by $ in A cover a regular hexagon, touching the boundary at the mid¬ 
point of each 1-dimensional face (see figure). The latter cases are of 
coiirse the decomposable games, with one player a diommy. 



_ Q 

EXAMPLE 3- The quota games ° are characterized by the existence 


g 

Discussed in [4]. 
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of constants satisfying 


WjL + “j = v((l,j)) 

^n“i “ • 


For n = 3, we have 


( 21 ) 


$ - 


e = 


(O > 0 
2 


(all 1, j G N, i j) 


Since cj can assume any position In A, the range of ^ is a triangle. 
Inscribed in the hexagon of the preceding example (see the figure). 

EXAMPLE 4. All four-person constant-sum games are quota games. 
For them we have 



The quota ranges over a certain cube,^ containing A. The value $ 
meanwhile ranges over a parallel, inscribed cube, touching the boundary of 
A at the midpoint of each 2-dimensional face. In higher quota games the 
points $ and o) are not so directly related. 

EXAMPLE 5. The weighted ma.iority games are characterized by 
the existence of "weights” w^ such that never = ^N-S^l^ 

such that 



r v(S) = n - s 

if 

Ss > 2n-S 

Wi , 



( v(S) = - s 

if 

Ss < Sn-S 

w^ . 


The game is 

shown that 

then denoted by the symbol 

[w,, Wg, 

Wn). 

It is easily 

(25) 

i>i < 

implies w^ < Wj 

(all 

i, j G N) 


in any weighted majority game [w^, w^, w^] . Hence "weight" and 

"value" rank the players in the same order. 

The exact values can be computed without difficulty for particular 
cases. We have 


^Illustrated in [i^], figure 1 (page 555 in this volume). 
’°See [3], ^ 50.1 . 
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(|) = (-1, -1, -1, n-1) 

for the game [1, 1, 1, n-2],” and 

If = I (1, 1, 1, -1, -1, -1) 

for the game [2, 2, 2, 1, 1, 1],^^ etc. 

i 6. DEBIVATION OP THE VALT3E PROM A BARGAINING MODEL 

The deductive approach of the earlier sections has failed to 
suggest a bargaining procedure which would produce the value of the game 
as the (expected) outcome. We conclude this paper with a description of 
such a procedure. The form of our model, with its chance move, lends 
support to the view that the value is best regarded as an a priori assess¬ 
ment of the situation, based on either ignorance or disregard of the social 
organization of the players. 

The players constituting a finite carrier N agree to play the 
game v in a grand coalition, formed in the following way: 1 . Starting 
with a single member, the coalition adds one player at a time until every¬ 
one has been admitted. 2. The order in which the players are to join is 
determined by chance, with all arrangements equally probable. 5- Each 
player, on his admission, demands and is promised the amount which his 
adherence contributes to the value of the coalition (as determined by the 
function v) . The grand coalition then plays the game "efficiently" so as 
to obtain the amount v(N) — exactly enough to meet all the promises. 

The expectations under this scheme are easily worked out. Let 
T^^^ be the set of players preceding 1. For any S 9 1, the payment to 
i if S - (1) = is v(S) - v(S - (1)), and the probability of that 

contingency is yj^(s) • The total expectation of 1 is therefore just his 
value, (13), as was to be shown. 


Discussed at length in [3], $ 55- 
^^Discussed in [3], ^ 53-2.2. 
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S^METRIC SOLUTIONS TO MAJORITY GAMEs’ 

Raoul Bott 

The purpose of this note is the determination of all symmetric 
solutions to a family of n-person games [1].^ A game (n,lc) in this 
class is defined by the value of the game v(S) for all coalitions S. 

If |S| is the number of players in S, then 

r - |S| for |S| < k 
v(S) = J 

[ n - |S| for |S| > k 

where k is a fixed Integer with ^ < k < n. 

This means that a coalition of k or more players can obtain the 
maximum possible amomt, and a smaller coalition is totally defeated. An 
(n-k+1)-player coalition is the smallest coalition which is large enough to 
block its complement from winning. Such a coalition, if its members act 
together, must be included in the final (winning) coalition, so we might 
expect that a number of these "blocking coalitions" would combine to defeat 
the remaining players, and that all members of a particular blocking coali¬ 
tion would receive the same amount in an imputation of the solution. The 
systematic theory will confirm this, and will show that this is the unique 
symmetric standard of behavior. This uniqueness is, however, completely 
lost when the condition of symmetry is dropped. Mr. D. B. (jillles has 
found an alarming number of unsymmetrlc solutions to these games, most of 
which could not be intuitively anticipated at all. 

The game (n,k) is zero sum only if k = - ^ , and in this 
case (n,k) is the n-person simple majority game. For k > - ^ , there 

exist pairs of opposing coalitions, both coirpletely defeated, so bhe games 
are non-zero sum. These form the symmetric generalization of simple games: 
every set is either winning or losing, but the game need not be zero sum. 


^The preparation of this paper was supported by the Office of Naval 
Research. 

^Numbers in square brackets refer to the bibliography at the end of this 
paper. 
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A symmetric solution V contains all imputations arising from 
permutations of the indices of any iii5)utation a G V, and is therefore 
characterized by its ’’ordered imputations” {a|a G V, a^ 1 1 **• 1 ^n^ ’ 

a g-b via S means 

®'i ^ ^i i ^ S, and |S| > k . 

If |S| > k, we can find a subset T of S with |T| = k, and a ^b 
via T, since all k-person sets are effective. Since V is symmetric, 
we may assume without loss in generality, for a G V, that the largest k 
components of a majorize the smallest k conponents of b. These remarks 
apply, of GOin?se, whenever a is a member of a symmetric subset of inputa- 
tions, and we are deciding whether or not at least one member of this sub¬ 
set dominates b. This leans to the following redefinition of the concept 
of domination. 

Let A be the simplex of ordered Inputatlons in Euclidean 
n-space defined by 


( 1 ) 


^11 ^ 


1+1 


( 2 ) > -1 

( 5 ) = 0 

Then domination (G-) is defined by 


a g-b if and only if for jr=1, 2, ...,k. 

Since all oior proofs require that the dominatinR Inputation be in a sym¬ 
metric subset of imputations, b can be assumed ordered without loss in 
generality, and proofs can be constructed relative to A by means of the 
above definition. 


THEOREM. Let p = n - k + 1, and write n = 
sp + r, where 0 < r < p. Let VGA be the sinplex 
of points a G A with the following properties. 

( 4 ) 

(5) 

^Thls is proved in [1], p. 439: (49:J). 


= -1 if r 0 . 


jr 0 mod p . 
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Then V is the unique solution in A. 

PROOF. We break up the proof of this result into a sequence of 

lemmas. 

lemma 1 . Let W C A consist of all points a 
such that . y O mod p. Then a solution 

V of A must certainly be contained in W. 

PROOF. Suppose a G V where V is a solution in A, and sup- 
pose a, < a. , for k < Iq < n. Let a* be given by 

at = ai + E , i io + 1 

^i^+1 ^ ^i^+1 - (n - 1)£ , 

where E > o is so small that a^^ ^ ^1 +1 ‘ Since a £- a, and hence 
cannot be in V, there exists ^ ^ b G V dominating a*,^ and we 

have b^+n-k > 4 • ’' ’ 1 < k < 1 ^ + 1 , a^ > a^, 

so b g-a, a contradiction. Thus the last p coordinates of an element 
in V must be equal. Next assiane a 6 V and a^ ^ +1' 

n-2p+1<lQ<n-p+1. Define a* as ° before. Again 

there exists b G V with b f-a*, and > a^ (1 = 1, ..., k). Now 

a* > a^ except for possibly 1 = 1^ + 1. But by our previous result, 
since b G V, we liave 


^l^+l+n-k ^1^+2+n-k 



proof now proceeds by induction in a straightforward manner. 

. lemma 2. Any solution in A contains all imputa¬ 
tions in W with a.j = -1 if r ^ 0. 

PROOF. A general imputation in W is of the form 

a = ^Qf •••j » • • • > ^ • • • f ^2* • • • 9 

and from our definition of domination we have, for imputations a, a' GW; 


a Er S' 


if ana only If <*i > «<-i 1=1.2,..., 
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Hence 


( 6 ) 

But since 

we have 

(7) <^0 + I X? ‘*1 = I ST '*1 0 • 

Combining (6) and (T) we obtain which Is Impossible If = -1 • 

Hence V contains all Imputations with a^ = • 

We have now shown two things: 

(1) The set V defined hy our theorem is satisfactory, that is, 
for a, h ^ V we cannot have a £-b- 

(2) V Is contained In every symmetric solution. 

The proof that there exists an Imputation a G V dominating any 
Imputation In A - V will show that V Is a solution, and that it Is 
unique since no superset of a solution Is a solution. 

lemma 5- For b G A, there exists an a G V 
with a g-b, imless b G V. 

PROOF. The required imputation a Is specified by the quantities 


*1' <*2' ■ 

..., oLg which must satisfy 


(8) 

p = r (since = 0) . 


(9) 

''l> V{l-1)p+1 1=1-2-- 

s 


(by the definition of domination). 


Summing (9) over 1, and substituting in (8) we obtain 

P ^r+(i-l)p+l ^ ^ ' 

which Is sufficient as well as necessary. But since b^ < b^^^ we have 

P 2)l=l^r+(l-1 )p+l Si= 1 ^^r+( 1-1 )p+l ^2l=l(2y=1^r+(l-l)p+y) Si=l^i‘ 
Now - < I* since b^^ > -1, with equality only If 
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-1 = - b 2 = The other inequality becomes equality only If 

^r+(l-l)p+l ^ ^r+ip 1 < i ^ s which defines an Imputation In V. 

Hence unless b £ V we can solve (8), (9) and dominate b. 

This completes the proof of the theorem. As mentioned earlier, 
this unique solution V Is entirely In accordance with our intuitive 
expectation. The ”p-coalitions" turn out to be the bargaining iinlts of 
this game. Further, their bargaining is entirely "free" except of course 
that they will between them completely exploit the defeated r players 
which are left over after the maximum possible number of p-coalltion 
receives the same amount. 

In the zero-sum case (n, ^ ^ ^ ) the solution consists of a 
finite set of Imputations, formed by permuting the Indices of the Imputa- 
tlon (-1, -1, .... -1, the main 

solution to the simple majority game In n players. For k > ^ g ^ , the 
symmetric solution consists of an Infinity of lnputatlons. 
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DISCRIMINATORY AND BARGAINING SOLUTIONS 
TO A CLASS OP SYMMETRIC n-PERSON GAMES ’ 

D. B. Gillies 

The application of game theory to economics and sociology awaits 
a general theory of n-person games. As yet, methods have not been found 
for determining solutions to all n-person games; nor is it known whether 
every game has a solution- The intensive study of a particular class of 
games provides einplrlcal data on the nature of solutions, methods which may 
be applied to other games, and may suggest or disprove conjectures on solu¬ 
tions in general. 

R. Bott defines the family (n,k) of n-person games in [1],^ and 
determines for each game the -unique symmetric solution. All unsymmetrlc 
solutions found in this paper can be related to symmetric solutions (to 
possibly different games of the class) by the systematic use of four de¬ 
vices . We shall study these devices in detail. 

(1) Certain symmetric solutions may be modified by the addition 
of arbitrary functions -- the so-called "bargaining curves" ([2], p. 501 ) 
which exist for an Infinity of these games. 

(2) A new type of discrimination occurs. A groi:^ of players may 

receive a variable amount, but be required to divide it in accordance with 
the symmetric solution to a smaller game. For example, the game (^,5) has 
a solution consisting of all imputations: (z, -1, 2 » 2 . ^ permuta¬ 

tions of the last 3 components for all z in -1 < z < 3- That is, player 
( 1 ) receives some admissible amo-unt z, and the balance is divided in 
accordance with the symmetric solution to the game (3 >2) . 

( 3 ) Any solution to (n,k) may be inflated ([2], p. 398 ) to a 
solution to (n+t,k) by assigning the t adaltlonal players fixed amounts, 
(provided these amounts are not too large, and provided both games are in 
the class). These are the "discriminatory" solutions ([2], pp. 288 - 289 ). 

(4) The fixed amounts in (3) are subject to strict inequalities. 


^The preparation of this paper was supported by the Office of Naval 
Research. 

^N-umbers in square brackets refer to the bibliography at the end of this 
paper. 
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In some cases one or more equalities are permissible if imputations are 
added and subtracted from the set, and a new solution obtains. 

DEFINITION. The symbol (n,k) denotes an n-person 
game whose value v(S) for a coalition S, numbering 
|S| players, is 

k 

> k, where n > k > ^ . 

every imputation related by a permu- 
a* - (a|, a^, a^;^) with 

i ^ r (mod p) 

> 0 , 

where p*=n-k + 1, n=sp + r, 0<r<p. 

That is, ^ ^ k that relative to a there exist s 

sets of players, each set of size p; the players in any one set receiving 
the same amount in a. The r players not Included in these sets each 
receive -1. 

Bott shows that domination is equivalent to domination via a 
k-element set, and that all k-element sets are effective. Ve shall there¬ 
fore consider only k-element sets in our proofs. A solution V is sym¬ 
metric over a subset S of components if it is left invariant by any 
permutation of these components. For such a solution, we may renumber the 
S-coraponents of a general imputation, since domination of this new imputa¬ 
tion implies, by symmetry, domination of the original one. 

It is desirable to Include also the games (n,n) in our class. 
For these, only n-person sets are effective, and the unique solution con¬ 
tains all imputations. (This agrees with the formula for • 

i 1 . SOLUTIONS WITH BARGAINING 

The symmetric solution to (n,k), can be defined as 

follows: 

An imputation a is in ^ if and only if there exist s 

numbers (oL^^} where -1 < 1 *^2 1 ‘ ‘ ‘ ^ '^‘s' disjunct index 

sets S^, S-, ..., S- such that 
o I » 


v(S) = 


- |S| for S < 
n - |S| for S 


The symmetric solution ^ contains 
tatlon of conponents to an imputation 


4 = 4+1 


-1 for r 
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( 1 ) 


ISol = r 

is^l = p if 1^0 


( 2 ) 

(3) 



-1 If vG Sq 
if VG Sj^ . 


Let r = 0 . Sq Is empty and 

(q,.(oL., ..., oL^)) be n fimctlons defined for every a G V„ (r = 0 ), 

V IS ic 

for which 


(1) •••> ‘‘■s^ + **l > 

( 2 ) ^v=r ' ■•■’ *3^ “ ° • 

These imply, for ot^ = -1, that q^(ot,, • • •, otg) = 0 for V = 

1, 2 , ..., n. Given a, define a vector q(a) = {qy(a)) = 

^ •••> o^g) + Q-y) • The conditions above are necessary and sufficient 
for q(a) to be an imputation. Define == {q(a) I ^ ^ 
slder additional conditions on the functions q to ensure that is a 

solution to (n,k) . 


DEFINITION. Two imputations ^ k 

called essentially different if they do not differ by 
just a permutation of components, that is, if 


oL^ ^ ®^1 ^ • 

THEOREM. A sufficient condition that be a 

solution is that for any two essentially different impu¬ 
tation a,a G we have 

lqY (*,, <* 2 > •••» * 2 » •••' ''*‘1 ■ ^±1 • 

PROOF. We first show that no l]i 5 )Utation in Vg dominates 
another. Assume the contrary, then q(a) ^q(a), that is, 
qy(dL^, ..., bLg) + a^ > qy(S^, oCg) + ay index set of size k. 

This inequality fails for at most n-k = p-1 Indices. If a,a are not 
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essentially different, ^ • • • > <^ 3 ) ‘ ‘ a ^ a, 

a contradiction. Otherwise we show that there exists an i = iQ such that 

^ I ^ ‘ ~ * * * ■ > ^ 

> .... olg) - q^(^L,. .... ^g) . 

If max 1^. - oi.| occurs for 1,, then either - oC > 0 , in which 

case i^ = i.j, or 

- \ > (s-Dlq^K) - q^(i)l • 

Hence for some i = i , <. - o(^ > iQ (<<) “ I * 

_ ■‘■Q ■‘■Q ^ ^ 

But q^(<Jl) + otj^ > q^(o() + o(j Implies 

< I q^(='.) - q^(^) I • 

For 1 = j = 1 q ¥6 have seen that this falls (for any v). Hence for 
j > Iq, 1 < 1q It falls a fortiori. That is, for j > Iq. a necessary 
condition for the inequality to hold Is 1 > Iq- So for the (s - 1^ + l)p 
components {v|ay> ) we can have at most (s-l|^)p Ineq-ualltles 
satisfied: {V|a^> . Thus the Inequality falls for at least p 

components and ° q(a) ^q(a). Hence is a satisfactory set. 

To show that any b $ Is dominated by some q(a) G V^, we 
consider s^arately the cases s = 2 , s > 2 . 

ST 5 )pose 3 = 2 , then - ol^ = + = p say, where 0 < /J < 1 . 

Sijppose b is an Imputation which is not dominated by any q(a) G Vg. We 
obtain a contradiction. Define Index sets 

T^(p) = {V|qy(^) + P < by} 

Tgdi) = (V|qy(p) + A > by > q^(p) - fi) 

= Cv|qy(p>) - p > by] . 

For t> ^ ^ , lqy(|2>) - qY(P*)l < IP - I so T, ,T 5 are monotone non-in- 
creasing sets. S\ 5 )pose Tj(^) Is empty for all including f, = 0 . 

Then q^(0) = by ann b G Vg. Otherwise let be the smallest ^ for 
which Tj(P) is empty (it is certainly empty at (S = 1). For ^ < P, 
|T,()i)l > p, for otherwise q(a) ^ b, where 
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q-y(a) 


' qy()3) - S for V = 6 T 5 (p) 

^ ^ P other indices in Tg+T^ 

qy(ji) - P> otherwise . 


But |T^(|i)| is continuous on the left, so |T^(ja)| > p. Let S be a 
p-eleraent set C (p) and define 


qy(a) = qy(^) + p> for VG S 
= qy(A) “A otherwise . 

Then always qy(a) < by so q(a) = b G V^, the required contradiction. 

For s > 2 , the proof that any imputation is dominated unless it 
is in the solution, is patterned after an alternative proof for the symmetric 
solution which we give in detail for the case r = 0 . 

Let b be any imputation, (indexed such that b^ ^^ 2 ^ ^^n^’ 

Define ^ X ^i_l )p +1 > ^( 1-1 )p +1 ’ equality only If all h. 

in the sum are equal. Let a be the imputation in ^ defined by 


®’1 + (i- 2 )p+}r ^ 1 ^ 1 P 

ij = if j > k . 


Then a^ > Lj for the first k indices, unless one or more of the sums 

are over equal bj. However not all such sums can consist of equal elements 

(or G so there is one, say > b^ -i)p+i * 

Let 51^ = b^^ -i)p+‘i + ^ °where ° > o, and define 

• • •, c(^)° by ° 

r =«k - (s-l)£ for i = Iq 

'"i \ 

= + £ otherwise . 

Then a defined as above, from ok, satisfies a £-b, and ^ k* 

This conpletes the proof. 

If s > 2, b $ Vq, define a vector function Y(oi.-) = 

b 2 ,-q 2 ,(^)> •••. (1', 2»,..., n») is the 

permutation of (l, 2, ..., n) such that Y] («*') ^ ^ ‘ ^ ‘ 

(This permutation is a function of ok, but the yy(dL) are continuous, and 
satisfy |Yy(ck.) - Yy(ok) | < max |oU - for 6L 51 .) 
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Define a vector function <l)(dL) by 

Then (fj^CoC) = 0 and |il>j^(<it) - i|»j^(5y I < ^ max |cl^ - for oC|^ ^• 

By analogy with the previous proof, we solve the ^ vector equation 
^ (oL) = oL, If possible. 

We shall form a sequence dt?, cl , dL 9 ••• where = <|>(ol ) 

and show that It Is a Cauchy sequence. Its limit, o[, satisfies (|)(ol) = d, 

since <|) Is a continuous function. However (|)(okf) Is defined only when 

can arise from some Imputation In so we must guarantee that 

> - 1- (Since = 0, we have °) • 

1 — o 1 

Define dL ,cL by: 

“ P )P+1 

„ 1 <*- 3+1 

oL° = fltj^ + for ± 7 ^ ^ ■ 

Then o = 1 = 2<*-j = ^ o<-° = -1» so qy(ct.°) = 

0, and from the definition of if we have <l>(ot°) = oO . Similarly If oi.| = 

-1, ot^ = (|)(oJ) = oJ and we have the solution ^ = oj . Assume then cii.| > -1, 
or 1 + dl > 0. Let = max - ctf |. Then /< = oil + 1 >0. Sigjpose 

kr l<j<l^ ‘^Then'^ 

/"l “ 

= lifjjCot.^) - 

< (^) max |4 - 

< ^ 1-1 • 

Hence 

Pi< (i^)^Ko • 

= -1 + 1 + ot| + (ot^ - Ol^) + (d^ " ®(-f) + ... + ■'*1^ 

> -1 + (1 + cl \) - |d2 _«.]! - locf _0t2| . ... _ _0Li| 


But 
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Hence 



> -1 

1 

1 

1 

1 

+ 





> -1 

^f*0 - 

+ ... 


> -1 + ;*o - 


> 

f*0 > 

/^o > 

0, s 

> 2 . 


> 

and oL^ is defined for all 

i. 

Similarly 

i4- 



- ^^+2 

1 + • 




< M • 





—> 0 as 1 —> 00 , and {oL^} is a Cauchy sequence, whose 

i£ ^ 

limit, satisfies 


oL^ > -1 

2^1 = ° 

= 51 . 


For this oC, we renumber the indices of b relative to a 
permutation (1', 2', n') which makes monotone. Then 

y^(ct.) = by - » “tgj • • • > ®tg) ^ " *^V+1 ’ ■ ■ ■ ’ '*'8^ 

V= 1 , 2 , .... n-1. If y(i_i)p+i = Yip =Si . 

then h 6 Vq since 1’(i_i)p+f = + q(l-1)p+ir (ot,, •••> otg) 

(1<y<p, 1 <Ci<Cs). otherwise, for some i = i^ 

Y(iQ - 1)p+l + s^= with E > 0 . 

Then define 

=51. - (s-1)£ for i = io 

o 

= *i + £ for i ^ 1 q . 

Then q(a) &-b, q(a) G Vg, where q(a) is defined by 
q, (a) = q, K.|, o<g) + oi, 

‘^i+(i-2)p+if “ ‘^i+(i-2)p+y ^°S’ 
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for 1 < JT < p and ^ < 1 < s 

q^(a) = •••, oLg) + oi^ for V > (s-l)p+l) = k . 

PROOF. We show that domination is via the set (1, 2, k). 

STjppose qi + (i. 2 )pH.)r(‘^V otg) + < b, (i_ 2 )p+y for some Index 

1 + (l-2)p + r with 1 < if < P- since 

l‘ll + (l-2)p+/'^1' •••' **3^ - ‘ll + (l-2)p+y(^l’ •••' IV\I = ^ 

the left side Is > qi+(i_ 2 )p+y(^l> •••* ‘ Transposing, we have 

“‘l ■ ^ ^ Yi + (i_2)p+y® ^ "^(l-Op+l® • 

For i ^ Iq, so we obtain a contradiction. If 1 = 1^, 

oL^ - g, = 6[^ - St = l)p+1^^^ which again gives a contradiction. Hence 

qy(a) > b,y for v < k? This con^Dletes the proof of the theorem. 

REMARKS 

(1) The presence of arbitrary functions qy(ck) in the solution 
bears a resemblance to situations in economics where bargaining occurs. 

(2) For s = 2, the proof can be strengthened to the case 
IQv^A) - qy(A*)l < IX - X*h and it is probable that equality is per¬ 
missible in the Lipschltz condition for s > 2 also, although this cannot 
be shown by means of a Cauchy sequence. 

(3) For r ^ 0 I have not found bargaining solutions of full 
dimension, although a smaller game can often be found whose bargaining 
solution can be Inflated to solve the larger game. In one case: 

(2p - 1, p) there are certainly no bargaining solutions of full dimension: 
this is the zero-sum case — the direct majority game which is a particular 
case of a simpl r game. In a simple game, either a set S or its comple¬ 
ment is always effective, so two imputations in a solution must have at 
least one equal component . 

f 2. A NEW TYPE OF DISCRIMINATION 

LEMMA. If V is a solution to an n-person game, 
and b = (b^, b^, b^) is a vector satisfying 

> -1 for 1=1,2, ..., n and 


< 0. 



DISCRIMINATORY AND BARGAINING SOLUTIONS 


553 


then there exists an Imputation a G V with a 

PROOF. Define h by = h^ + £, 1 = 1, 2, ..., n, where 

^ = H > ° • 

Then b Is an Imputation. If b $ V there exists a G V with a b, 
and a £-b a fortiori. If b G V, then b ^b via the effective set I 
of all n players. The symmetric solution to (n,k), has a very 

Interesting property If r = p-l, In the light of this lemma. There are 
p-1 components which are -1, so given any vector b satisfying the 
conditions of the lemma, we can never have, for s- ^ k * 
more than k Indices. The transformation T(X) : a —■]> a(X) defined by 
a^ —•> a.^(^ + + n ^ ^ ^ ^ ^ ..., n has the properties 

(1) aj_ = -1 Implies = -1 

(2) If X > -n, > -1 Implies a^(X) > a^(X) > -1, 

with equality In the transforms only If X = -n. 

(3) X±t^ ai(X) = X + (1 + f) (= X If = 0). 

(^4-) If T(X) Is applied to all Imputations a G the 

image Is a solution to the strategically equiva¬ 

lent game defined by v(I) = -X : 

r - |S| If |S| < k 

v(S) = 

I n - X - |S| If |S| > k, where X > n . 


If (n^,k^) (n2,k2) are 2 games with r^ = p^ - 1 = n^ - - kg, 

and If (V T_ ) is the set of Imputations (a,b) In an 

n^,x^, n2,K2 

(n- + n^)-dimensional space where a G V„ t, > ^ , we might expect 

(V„ T, (X), 1, (-X)), - n- < X < n„, to be a solution to the game 

n^ ,K.^ n2,K2 • — — ^ 

(n^ + ng, k^ + kg) • We prove a more general theorem: 


THEOREM. Let (n^,k^), (ng,kg), ..., (ng,kg) be 
g games satisfying the conditions r^ = n^^ - k^ = p^ - 1 
for 1=1,2, —, g. Let A be the space of Inputa- 
tlons for the n^)-player game (n^ + ... + n^, 

k^ + ... + kg), and let , ..., Sg be g fixed index 



OTLIiiJ^ 


sets for A with 

ISjl = 

h Sj = the null set . 

Number the Irdlces In ^ with the same in¬ 
dices as (i = 1, 2, gf ^ in some order. If 

V = {a(X) = (a] (X^), ..aS(Xg)) I , 1 = 1, s, • • •, g ; 

Xj^ > - iijL and % = °} 

then V is a solution to (n,k) = ( 

PROOF. ¥e have seen that domination means domination relative 
to (nj^,k^) for every index set S^, and also that there exists 

a^(X) G V 1, (X) dominating any extended imputation b with 
^i"^i 

b. < X.. S-uppose a(X) ^a(Y) and a(X), a(y) G V. Now 

Z? X^ = Xf • Then for some i = i , X^^ ^ • Then 

^11 -L o “ 0 

a °(X. ) if a. °(Y. ), so the relation a^{X) > a^(Y) can hold for at most 

X^^± ki + (k^ - 1 ) = 2 k ^-1 indices. Hence a(X) ^a(Y). Given b $ V, 

we ~ ^determine® X^ = S-ra For at least one "subgarae" S. we have 

1 __ i 1 J i ^o 

a °(Xj_ ) ^b where b ° is the extended ln^jutation consisting 

only ° of the components whose indices are in . This gives k^ 
strict inequalities, so, for £ > o sufficiently ° small, ° 

1 i 4 _ 

a °(Xj^ - (g~l)£) g-b We can then determine imputations a (Xj. + S) ^b 

for ® i ^ Iq, and 

(a’(X, + S), a^(X„ + £), ..., a^°(X. - (g - 1 )£), a^°'"\xj^ ) 

dominates b. (Since £ > o, X^ ^ - n. , but this is certainly true, since 
1 -^o -^o 

a °(-n. ) = (-1, -1, ..., -1) which does not dominate anything). 

REMARKS 

(1) (n^ ,k^) can be the game (1,1) or more generally (n^ ,n^) . 
Examples of admissible games are ( 3 , 2 ), ( 5 , 3 ), ( 5 ,^), ( 7 ,^), ( 7 , 6 ). 

(2) In each Imputation in V, the players who do not succeed in 

joining a coalition receive -l . In there are n^-kj_ such players. 
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Certain amounts are assigned t 6 the sets S^ and are divided among 

the players in S^^ according to the symmetric solution to the smaller 
games. 

(3) For n large, the decomposition of (n,k) Into 
Sk^) can be attained In a prodigious number of ways satisfying 
our conditions on (nj^,kj|^). The multiplicity of solutions so obtained, and 

the variety of social structures so described seem surprising In these 

symmetric games. 

i 3. INFLATION OF SOLUTION 

V is called a discriminatory solution to (n+t,k) If there 
exists a partition of Indices Into two sets S,T with the properties (l), 
( 2 ): 

(1) 1T| = t |S| = n 

T U S = I, the set of all players . 

(2) For all a e V, a^ = Cj^ If 1 G T, where {c^^J are t 

constants each greater than or equal to -1. Let be the set of 

constant-sum Imputations {a^3 In S obtained by projecting V = [a] 
onto S. These have a sum - since o = ^1 

SiGS ®-l “ SieT °1 * 

LEMMA,. V® Is a solution to the game strategically 

equivalent to (n,k) where 

V(S,> = - |SJ If IS^I < k 

= n - IS, I - If |S,| > k . 

S T 

PROOF. Let b be an imputation with projections b ,b-^ on S 
and T and assume b^ = c. We show that b^ Is either in or domi¬ 

nated via an effective set In S. If b € V, the lemma follows. Otherwise 
for some a G V, a^^ > b^ for k indicep However = b^ for 1 G T, 
so the k indices must be in S. Hence a^ which was to be proved. 

We propose to reverse this process, and study the Inflation of a 
solution to (n,k) by assigning t additional players fixed amounts. 

By strategic equivalence, we can consider the game for which ^ 

so ^ = V The relation: "k-player sets are certainly necessary, and 
all other sets are certainly unnecessary" is sufficient to define the game 
(n + t,k), for k > is Invariant under strategic equivalence, and 
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Is the only relation used in o\ip proofs. Let X he chosen so V(X) has 
^ ° ^ hence Si^T 

1 G T (the Cj^ will differ from their zero-sum analogues in V). Where 
no confusion could arise imputation will he used in one or other of two 
senses: 

(1) An element h G A where A is the (n+t)-dimensional space 
of extended imputations over S L/ T. 

hi > -1 

= X . 

(2) A zero-sum imputation over the indices in S. 

THEOREM. A sufficient condition that V(X) he a 
solution to (n + t,k) over A is max c^ < „ ^ , , 

If k > S±t . IGT i ’ 


DEFINITION. An loiputatlon h is certainly un¬ 
necessary if we know (owing usually to the domination of 
certain related lnputations) that it can he dominated hy 
an a G V. Otherwise, h is certainly necessary. 

LEMMA 1 . The imputations h with for 

exactly 1 components L C T are certainly necessary 
if and only if (1) 2 is a maximum for all | L | == 1 

( 2 ) r-1 for 1 G L 

Ci for i G T - L , 

for 1=0, 1, ..., t. 

PROOF. It is evident that these are exactly the luputatlons, 
for fixed 1, for which ^ ^na^lniuiD- Thus given an imputation 

h* with hj < c^ for exactly 1 components we can find an imputation h 
in the set defined hy the lemma, with h^ = hj + E > 0 for all 1 G S. 
If V(X) 3> a ^h via the set U, then U U S contains at least 
k + t - 1 components a^ > h^ > hj, and a^ > h^ for 1 components in 
T. Hence a ^h*, so we need not consider h*. Q.E.D. 

For 1 = 0, the theorem now follows from the fact that V is a 
solution to (n,k). 

It remains to find a G with a^ > h^ for a set of 
indices {1}. If Lg is an index set in S with 
(1) iLgI = 1 > 0 


k - 1 
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(2) 2 iGL ^1 ^ maxi-mum for all sets U C S with |U| - 1, 


define b*, an 


Imputation over the indices S with 




-1 If 1 e L„ 


if 1 e s - Lg 


If ^ tiy S' previous lemma, there exists a G with a fc-b* 

. ■. ^ bj for k components 

.'. a^ > bj^ for at least k - 1 components, 
since bj ^ for at most 1 components. Then if a is defined by 



for i G T 
for i G S 


then a G V(X) and a ^b as required. 

In view of this proposed construction, those imputations for 
which 2 bj is maximized are certainly necessary, and all others are 
certainly unnecessary. Also 2 ) bJ is maxJjnlzed if and only if 


b^ = constant for all 1 G S, (1 > 0) , 

since b* obtains from b by replacing the largest 1 components in S 
by -1 . 

Number the indices in T( 1 , 2, ..., t) such that ^ 

^ ^2 ^ ‘ ^ ^t' Then 2^^^^ = ^1=1 ^1=1+1 ^1 ~ ‘^l ” 

(1 + Sii-j c^), and for 1 G S, b^ = ^(1 + • Then 

^IGS = (n - 1)^(1 + Siii c^) - 1 which is < 0 by hypothesis. 

Sii, <!-'•".«• 

But for 1 > 2, this condition follows a fortiori from the relation 
c, > Cg ...“> Cf and c, < . Hence max Is a sufficient 

condition. 

Thus every solution to (n,k) can be inflated to a solution to 
(n + t,k) by assigning the t additional players constant amounts less 
than throughout. The inverse transformation T”^ (X) maps this 

solution V into a solution to the normalized game. 

The construction of b* was necessarily crude since we know 
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nothing about the solution If is the symmetric solution 

then an imputation ^ ^ 'k chosen to majorize the smallest 

k - 1 components of in S. In our former notation, an imputation 

^ ^ ^n k characterized by the s quantities •••, oCg), where 

now we do not insist that ^ (q--l)p < k - 1 < qp, 

then for 1 > q we may set c<^ = -1 . Let (1', 2*, n*) 

1 ^2* ^ ‘ ^ ^k-l» ^ ^ ^n* <ief*ine a numbering of the indices in 

S. If (q-1 )p + >1 = k - 1 define b>j + (i - 1 )p + £ = 1 < 1 < q, 

where £ is chosen so = 0. 

If a is defined by 

El = Eg • • • = a,j = 

E(1-2)p+)]+ 1 = ••• = ®’(i-i)p+Y| = **1 2 < 1 < q 

E(q-i)p+7^+l = ••• = Sqp = 
ay = -1 otherwise 

(where for simplicity in notation the primes are suppressed) then 
for 1 < (q“l)p+ij = k - 1 provided £ > 0. 

THEOREM. If is the symmetric solution to 

(n,k) and V(X) is the set of Imputations formed by 

assigning t additional players fixed amounts, then 

V(X) is a solution to (n+t,k) provided max c^ < —^ 

j 1 n— A 

where 


r if r ^ 0 
p if r = 0 . 


This condition is necessary and sufficient. 


LEMMA.. If the above construction is planned (and 
it ^ the best possible), then the imputations b £ A 
for which 


b 


1 


for 

i £ T 

- L 

(1) 

-1 for 

1 G L 


(2) 

-1 for 


in S 

( 3 ) 

constant 

otherwise . 

('^) 
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are certainly necessary, and all others are certainly 
unnecessary. 


PROOF. (( 1 ), (2) follow from the proof to the previous theorem 
and (3), (^) obtain by minimizing t) • b^^ = 1 + before, 

and the constant value for b^^ in all but (i] - 1 ) components of S is 


n->;+2 


(i+»i -1 + Xiii Cl) • 


Since 


a^ — 0, 


pq 


[ (1 M * Xl °i> ^ t ] - '■"-P‘1) = 


Inposing the condition ^ > 0 and slnplifying the resulting expression: 

Sii, =.* ■ 


The right hand side is proportional to 1 if q stays constant, however 
when q decreases by 1 (as 1 increases) the constant of proportionality 
increases. Since c^ > Cg > • • • > c^, the inequalities above are implied 
by the first one. For” 1 = 1 , q = s unless r = 0 in which case 
q = s - 1 . 

Hence 


if r ^ 0 
otherwise . 

This shows that the condition is sufficient. But the use of certainly 
necessary Imputations and optimal constructions implies necessity also 
(which can be independently verified by obtaining a contradiction for 

COROLLARY. Any zero-sum imputation b is in at 
least one solution to (n,k) . 

PROOF. Index (b^) so <'^2 i. ' •' define 

I' 

It can be verified that b(X) has Sn-k+l ^l^^^ ^ Since T(X) is a 
monotone transformation 

mx ti(X) = l=^_y,a) < H^Xn-k+1 ^ 1 '^) = ° • 

1 < n-k 


max c_. < ^ 
i ^ 


r 

n-r 

n-p 
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Let = h^(X) for 1 ^ k, and let V be the set of all 

impii tat Ions {a} With a^^ = for 1 ^ n - k. Then V is an inflation 

of the syinmetric solution Vjj. ^ to the game {n,k ), with max Cj^ ^ k^ ' 

Since b(X) G V, b is in the*analogue of this solution in the space of 
zero-sum imputations. 

The inequality obtained for the symmetric solution with k = n 
is max c^ < which agrees with our general theorem. The condition 

of ^ the general theorem is therefore the best possible (as a function 
of n only). 

i 4 . LIMITING CASES OP INFLATION 
S\5)pose c^ = C2 = • • • where 

" r if r ^ 0 

A= . 

p if r = 0 . 

Then if 1 < min (i^. A) and otherwise (1 < t). 

In fact the siammation need only be carried out over a set containing 1 
Indices in (l, 2 , , 1 ^). Our previous arguments show that the only 

imputations in A undomlnated are the certainly necessary ones: If L 
is any set in (l, 2, i^) of exactly 1 indices and Lg is any set 

in S of >j-l = A- l indices, then the imputation b defined by 

^ -1 if i 6 L U Lg 
bi=Jcj^ if i6T-L 

jh ^ 1 6 5 - Lg 

is undominated by any a G V, for all choices of L,Lg. Let V be the 
union of these imputations for all choices of (Since 

|L| + |Lg| = l + A- l= A<k, no imputation in V can dominate another 
(for the effective set must be L U Lg). Then V + V is a solution unless 
there are imputations b t V, a G V with b 

For A = r 0, i “^i = “‘i ^ 

one 1 = 1 ^. But b ^a is only possible via a k-element set in S, and 
there are p = n - k + i elements ay = for which by y a^. Hence 
V + V is a solution if r ^ o. 

If A = p, r = 0, the average value of the is 

i Si-1 so we exclude from V all imputations a* for which all 

are less than - Call this restricted set V*. V - V* is not 
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needed for the domination of an imputation having 1 > o since by con¬ 
struction the imputation required for domination could have p components 
equal to -1, hence some p components are greater than or equal to 
, as required. For 1 = 0, the arbitrary imputation has either 
n - k + 1 = p indices in S not less than , in which case it is 

dominated by an Iniputatlon in V - V*, or has not more than n - k ele¬ 
ments not less than , in which case it is dominated by an imputation 

in V. ¥e have proved: 

Theorem. If = C2 = c^ = , and V is the Inflated 

solution to (n + t,k), let V be ^ the set of all imputations having 1 
components in (l, 2, ..., i^) equal to -1, A - 1 components in S 
equal to -1, ( 1 = 1 , 2, ..., minCX,!^) the other components in T equal 

to c^, and the other components in S equal to . Let V* be the 

set of imputations in V with a^^ = for all i G S (V* is empty 

unless r = 0) . Then V + V - V* is a solution to (n + t,k). 

The discrete solution (a finite number of Imputations) to the 
3-person game (or more generally to the game (n, , which is zero sum) 

can be obtained by inflating Vg g (or n+1^’ limit. 

CONCLUSIONS AND CONJECTURES 

( 1 ) Inflation, and inflation to the limit, are very important 
methods for obtaining new solutions once a discriminatory solution is known. 
In the latter case, it often happens that much of the original solution is 
omitted, at the cost of adding a finite number of imputations, and this is 
very useful in finding finite solutions themselves. 

(2) By carrying out the Inflation relative to this particular 
strategically equivalent game, it is evident that the limiting solutions do 
not depend on possibly carrying out the inflation one component at a time 
all possibilities are subsumed in this general theorem. 

(3) The games ( 2 n+l, n+l) are the only zero-sum games in this 
class (they are the simple majority games), and it is evident that the 
natural way of determining their solutions is by means of the family i(m,k)] 
of associated non-zero sum games. Finite solutions have been found only 
for zero-sum games, and the larger the ratio — becomes, the higher is the 
dimensionality of the solution. 

( 4 ) The natural way of considering all solutions found so far 
is in terms of symmetric solutions. 

(5) Non-dls criminatory bargaining solutions probably do not occur 
for games with r 0, (This is true in the zero-sum case, but remains to 
be shown otherwise). 
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QUOTA SOLUTIONS OP n-PERSON GAMEs’ 

L. S- Sliapley 

f 1 . SUMMARY 

Complete seta of solutions for all three-person games have been 

2 

given by von Neimiann and Morgens tern. For higher games the known results 
are scattered, with no solutions at alx for large classes of games and 
complete sets of solutions for only a few special types.^ Even the exist¬ 
ence of solutions in all cases lias not yet been established. 

In this note we present a family of solutions for a class ^ of 
n-person games which embraces all constant-sum four-person games and a not 
inconsiderable array of higher games.^ We call them "quota games" because 
it is possible in them to define a system of individual quotas for the 
players which determines the effectiveness of the various two-player 
coalitions. In our solutions most of the players receive their quotas, 
but there is some latitude for bargaining.^ The solutions are typically 
one-dimensional sets, consisting sometimes of n line segments joined at ' 
the qaota point, sometimes of n-l disconnected segments. Their behavior 
undei variation of the characteristic function of the game is continuous. 

In the final two sections we present some related, more compli¬ 
cated solutions to games in Q, and describe an extension of the earlier 
results to a wider class of games. 

i 2 . PRELIMINARIES 

We shall enploy the symbols G, £, A ,u , - , in the customary 


^ The preparation of this paper was sponsored in part by the RAND Corpora¬ 
tion and the Office of Naval Research. 

^J. von Neiomann and 0. Morgens tern, "Theory of Games and Economic Behavior, 
Princeton, 19^7 ("TGEB" in the sequel): sections 52 and 60.5. 

5g00 e.g., TGEB: 36 . 1 . 1 , 54.2.1, 60.4.2; also other papers in this volume. 

^See the tables on pages 347 and 359 below. 

^Details are given in the heuristic accounts which accompany Theorems 3, 

4, and 5• 
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vay; ¥e shall use {1, j, m) for the set consisting of the distinct 

elements i, j, m, without regard for order, and |S| for the number 

of distinct elements in the (finite) set S. Greek letters without sub¬ 
scripts will represent n-vectors j ^ will stand for the vector whose 

1-th component is 1, all others 0. By [ci,f] we shall mean (imtil 
section 6) the set of vectors of the form 

(1) tcL+ (1 - t)[J , ^ ^ 1 

— geometrically, the straight segment joining oC and f>- 

Let I denote the set of players; |I| = n. A general-sum 
n- nerson game v is a fimctlon from the subsets of I to the reals 
satisfying 

(2) v(0) = 0 , 

(3) v(S T) + v(S - T) < v(S) , (all S, T C I) . 

It is constant-sum if there is equality in (3) for S == I: 

(4) v(T) + v(I - T) * v(I) (all TCI). 

If equality always holds in (3) for some particular T, then the game is 
said to be decomposable into the games on the sets of players T and 
I - T; if such a T consists of a single player, he is called a dummy . 

If all players are dummies, then the game is inessential , and its theory is 
trivial. 

We shall sometimes write v^, v^j, etc., for v({l}), v(li,j)), 

etc. 

The space A of "imputations" is defined as the set of ©L which 

satisfy 

(5) "*1 “ 

(6) (all i C I) 

— geometrically, an (n-i)-dimensional simplex. If 

(7) (all Its), 

(8) Si6s 

both hold, we say that p S- dominates ol, and write dL t S-dom p. It is 
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easily verified that S-domlnatlon can occur between two liqputatlons only If 

(9) 1 < |S| < III . 

We now define the dominion of a single vector: 

(10) dom d. = S-dom dL , 

and of a set of vectors; 

(11) dom V = 

Finally, V is a solution (of the game v) if and only if 

(12) V = A - dom V . 

i 3. QUOTA GAMES 

By a quota in a game v we shall mean a vector uj having the 
two properties: 

(13) - VjLj (all i ^ j) , 

( 1 *^) 2 i6 I '*^1 = v(I) . 

From (13) we see at once that, for III > 2, the quota, if it exists at 
all, is unique. Let q. denote the class of games which possess quotas, 
the "quota games." 

THEOREM 1 . The n-person game v is in if and 
only if 

( 15 ) + v^^ - v^ + (1, j, k, 1 distinct) 

always holds, and 

( 16 ) SljGI ^Ij = 2 (n - Dvd) . 

if j 

PROOF. ( 13 ) and (A) directly yield ( 15 ) and ( 16 ). Conversely, 
given V satisfying ( 15 ) and (l6) and n > 3 (the theorem is trivial for 
n = 1, 2), the expression 
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(17) ‘^1 = 1 ^'^ij ^ik ■ ^ distinct) 

is independent of j and k, and can be used to define a vector u). ( 13 ) 

now follows from (IT)- To obtain (H), simi (17) over all distinct (ordered) 
triples (i, j, k), thus: 

( 18 ) (n - l)(n - 2 ) 1 (n - 2 ) 

(the last two sums cancel). An application of ( 16 ) now gives the result. 
COROlIiARY 1. If n is even, ( 15 ) follows from 

( 16 ). 

PROOF. Let TT be a partition of I into two-element subsets. 
Then, by ( 3 ), 

( 19 ) ^SGTT ^ * 

Averaging ( 19 ) over all such partitions we obtain, since each S will 
occur the same number of times: 

( 20 ) ^ Ss(-J v(S) < v(I) . 

|ST=2 

By ( 16 ) we have equality here, and hence alsc) in ( 19 ) for every TT. ( 15 ) 
now follows easily. 

COROLLARY 2. If n is even, the ’ v G if and 
only if 

( 21 ) v(S n T) + v(S - T) = v(S) 

holds whenever |S|, |SnT|, |S-T| are even. Thus, 
in even-person quota games, 

( 22 ) Xigs *^1 = v(S) (all SCI, I SI even) . 

PROOF. Assume v G <{. By (5), (1 3), (1 ^), we have 

(23) v(S n T) + v(S - T) + v(I - S) > "l " ^Igs-T “i + ^IGI-S “i 


= v(I) 
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> v(S) + v(I - S) , 

if all the sets in question have even numbers of elements. Then ( 21 ) 
follows from ( 25 ) and (3)- Conversely, (21) Ijiqplies (15)> permitting us 
to define u> by (IT) (except In the case n - 2 , for which the corollary 
is trivial). This vector has the quota properties ( 13 ) and (14), as 
required. 


COROLLARY 3- All inessential games, and all con¬ 
stant-sum four-person games, are in 

PROOF. For Inessential games, put = Vj^, all 1 G I. For 
constant-sum four-person games, apply Corollary 2 , using (2) and (4). 

An idea of the extent of the class Q may be gained by repre¬ 
senting each n-person game v as a point in the cartesian space of 2^ 
dimensions and then comparing the dimension of the (convex) set of quota 
games with the dimension of the (convex) set of all games. In such repre¬ 
sentations it is customary to consider just games in "reduced form" and to 
disregard inessential games.^ This has the effect of making the convex 
sets bounded, and of reducing their dimensionality by n + 1, without 
substantial loss of generality. The comparison follows, calculations 
omitted. 


n 

All 

general-s\mi 

games 

constant-sum 

Quota games 

general-sum constant-sum 

2 

0 

(none) 

0 

(none) 

3 

3 

0 

2 

(none) 

k 

10 

3 

7 

3 

5 

25 

10 

19 

4 

6 

56 

25 

31 

15 

(even) 






2^-n-2 




(odd) 






A quota is not necessarily an inputatlon: condition (5) is 
assured, but not (6). Define the quantities c^: 


^Compare TGEB 39. Use of the reduced form in the body of this paper would 
tend to obscure relations and results, without producing any substantial 
sli^lif Icatlon. 
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(24) °i “ ■ '^1 ^ 

_they are effectively the barycentrlo coordinates of <-» In the simplex 

A. A player o for whom Is negative is called weak . A dummy in an 

essential quota game, for example, is weak. (Indeed, we then have, for 
each 1 o, 

(25) °0 = “o - (V - ^1^ = -‘l ^ '"l = '“l ' 

Whence 

( 26 ) °o ^ ■ n^ ^lei °1 • 

'T 

This quantity is negative in an essential game.) 

THEOREM 2. In a quota game there is at most one 
weak player; if |I| is odd, there is none. 

PROOF. By (3) and (13) we have, for any i j, 

(27) + Vj. < + Wj . 

Therefore i and j cannot both be weak. Furthermore, if |I| is odd, 
we have for any i: 

( 28 ) v(I) - > v(I - (i)) > = v(I) - , 

jVi 

by applying successively (3)> (15) Q-nd (3)y and (1^). Therefore i alone 
cannot be weak. 

k . QUOTA SOLUTIONS 

We shall now proceed to construct solutions to games in ^ out 
of the quotas, w, (when in A) and certain closely related imputations. 
We define the vectors: 

(29) = u) - + Cj_rf^ ; 

(50) + (CjL + • 


'^¥e return to this game in section 5; it is the only Instance of a decom¬ 
posable quota game. 
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In referring to these vectors, we shall sometimes speak of j as the 
"beneficiary" of i. 

LEMMA.- If there Is no weak player, or if i is 
weak and j ^ 1, then is in A. If k is weak 

and i, j ^ k, then is in A- 

PROOF. Immediate, from the definitions. 

THEOREM 3. If «*> ia in A, and if ^ 1 is 
an otherwise arbitrary function from I into itself, 
then 

I I ^^1 

(31) ^b ='^1GI ^ 

is a solution of the quota game v. 

GEOMETRICAL LESCRIPTION - Vj^ consists of n segments parallel 
to edges of A radiating from **>, one to each (n-2)-dimensional face. 

If a) is in the boundary, then one or more of the segments is degenerate? 
but all are degenerate only if A is degenerate as well -- l.e., if the 
game is Inessential. "When n is even, it is possible to have b^ « i, 
all i, whereupon the segments are colinear in pairs, and ^ consists 

of n/2 segments meeting perpendicularly at w. 

VERBAL DESCRIPTION. The standard of behavior attributes to each 
player a quota and a beneficiary? a player may be the beneficiary of 
several, or none, of his opponents. In a particular play of the game 
either all players take their quotas, or one player accepts less and gives 
the difference to his beneficiary. However, no player ever receives less 
than the minimum which he can guarantee himself unilaterally — thus, a 
player whose quota and minimum are equal will never assume the role of 
benefactor. When the number of players is even, one solution (mentioned in 
the preceding paragraph) has them pair off, as if to bargain over the 
division. In a particular play, any one pair may divide their combined 
quotas in an arbitrary way, compatible with their minima, while the others 
settle for their individual quotas exactly. 



PROOF OP THEOREM 5- 

(I) To show A - doir 

1 C v^. The 

A fall into three categories; 

f (1) el, < (0, 

(some i), 

-"j < “j 

(some j 1); 

(52) A 

1 < '**1 

(some 1), 

'^0 > “j 

(all ifii.)} 

1 

(111) ^ 

(all i) . 
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In the first case we have dL ^ (i, jl-dom w. In the second case we have 
(35) 

We can therefOTO choose t to satisfy one of 


{5^^) 


I 


The vector p: 
(35) 


t = “i - ' 

(lib) - "b^ < t S • 


p = 0) - t<r^ + tcT 


is in and we have either d, * P or d g (1, bjL}-dom p. In the third 

case we have at once = lo. Hence every lii5)iitation is in either or 

dom V-j^. (II) To show Vj^ C A - dom V^. By the lemma, V-j^ £ A. A simple 
check of the conditions (7), (8), (9) for domination reveals that the 
assimiptlons d G V^, ^ ^ ^ inconsistent. Hence no 

imputation is in both Y-^ and dom Vj^. 


THEOREM If w is not in A, let o denote 
the weak player. Then 




IGI 

Vo 


ii 


ol 


iob^ 

)f 


is a solution of the quota game v, with b as in 
Theorem 5- 


GEOMETRICAL EESCRIPTION. Vj^ consists of n-1 unconnected seg¬ 
ments parallel to edges of A, Issui:^ from points in the face A^ defined 
by 

(37) - ^o ° ' 

and running one to each of the other (n-2)-dimensional faces. Some or all 
of the segments may lie within A^, and some or all may degenerate to points 
in the boundary of A^; but all degenerate if and only if o is a dummy.® 


®See (4i) below. 
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VERBAL EESCRIPTION. The standard of behavior assigns quotas and 
beneficiaries as before, but the weak player's quota la below his minimum. 
In a particular play there is always one benefactor; he may be anyone but 
the weak player. He first makes up the weak player's deficit out of his 
own quota, and then, perhaps, gives an additional amount to his assigned 
beneficiary — who may also be the weak player. The remaining players take 
exactly their quotas. 

PROOF OP THEOREM 4. (I) To show A - dom V^ C V^. Divide the 
cL in A into the categories of ( 32 ). In case (1) we must have o ^ 1, j. 
Let k be distinct from o, 1, and j (possible by Theorem 2*.); then 
eL G [i, j}-dom In case (11) we must have o ^ 1 and 

( 38 ) ^1 1 ^i • 

We can then find, in the manner of the preceding proof, an imputation fi 
lob^ 

in y such that either dL = p or a. G {1, bj^)-dom 

Case (ill) is vacuous, since o) t A. Hence every imputation is in either 
or dom Vi^‘. (II) To show C A - dom Proceed as in the proof 

of Theorem 3- 

i 5* DISCUSSION. THE POUR-PERSON CONSTANT-SUM CASE 

Because of the arbitrariness in the choice of the beneficiary 
function b. Theorem 3 gives (n-l)^ solutions to each n-person quota 
game with to in A. These are all distinct if and only if u) is interior 
to A. If the game v is varied the quota u>, and hence each 
changes continuously. Therefore the solution is a continuous function 

of V. 

If V is varied so that c^ vanishes for one or more 1 G I, 
putting u> in the boundary of A, then those solutions whose beneficiary 
functions agree except for such i will become Indistinguishable, since 
the segments [U), will have contracted to the single point «*>. With 

(0 at a vertex of A there are only n-l distinct solutions (consisting 
of single edges of A). With oi in an open (n-2)-dimensional face of A 
the number la (n-l)^“^. 

For CO outside A we turn to Theorem 4 and find, in general, 
(n-1)^”^ solutions, again depending continuously on v. If v is varied 
so that Cq tends to 0 from below, then u) approaches the boundary of ^ 
A from the outside, and the points and approach co and 

respectively, so that each Vj^ of Theorem 4 goes in the limit into the 
corresponding of Theorem 3- The transition from one case to the other 

la perfectly continuous. 
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If V is now chosen to make , 

(39) °1 = - °o > ° 

for one or more 1 G I - (o), then the number of distinct solutions 
provided by Theorem h is reduced as a result of the segments 

contracting to the isolated points The quota games in 

which ( 39 ) holds for all 1 7 ^ o are noteworthy, since they alone have 
finite quota solutions. It can be shown that, for such a game. 


(40) 

v(S) = 2 i6s - 

0 

0 


(for 

|S| odd) , 


= ^les ^1 - 

0 

0 

CVJ 

1 

OQ 

(for 

|S| 

even, 0 G S) , 


“ ^IGS - 

(|S|)Cq 

(for 

|S| 

even, 0 $ S) . 


The game is constant-sum^ and symmetric in the essential players, o is 
a dummy, and, of course. III is even. The unique quota solution, by 
Theorem h, consists of the n -1 separate points; 

(*H) pi = V - Sjgj (all 1 yi o) 

j/0,1 

k 

where V denotes the vector • 

In the four-person case, visualization of the foregoing dis¬ 
cussion is aided bj a remarkable one-one correspondence that exists between 
the range of u) (ti.-« imputation space A and its environs), and the 
parameter space ol games v. von Neumann regards the essential four- 
person constant-sum games in reduced form as the points of a certain cube 
Q. (See Figure l.) 


^Indeed, it is an open question whether finite solutions exist except for 
constant-sum games. 

^^TGrEB 5l^.2. Figure 1 has been drawn to conform to Figures 61-63 
loc. cit. 
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VII III 



Figure 1. Partition of Q into the 
tetrahedra T, T^, Tg, T^, T^. 


Four of the vertices of Q (o in the figure) are the games with dummies; 
the other four (•), spanning the inscribed tetrahedron T, are the games 
in which one playec is so strong that only a coalition of all his opponents 
can defeat him. The four other tetrahedra Tj,, named after the dummies in 
their vertex games (o), form the complement of T in Q. 

Now it is possible by a linear transformation mapping the Imputa¬ 
tion space into the game space to superin 5 >ose A on T in such a way that 
<*> coincides with v for every game v. The range of is then exactly 
Q. Theorem 5 (no weak players) applies to games in T, while Theorem 
(1 weak) applies to games in T^. T conprlses one-third of the volume of 
Q; each T^, one-sixth. The relation of the weak-player games to the 
whole set is well Illustrated by this r^resentation. 

^ 6. FURTHEK SOLUTIONS INVOLVING THE QUOTA 


A study of the three-person quota games, whose theory is com- 
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pletely known, reveals that the quota w belongs to every solution, and 
that the solutions provided by Theorem 3 are special cases of a continuous 
family of solutions, consisting generally of arbitrary monotonlc curves 
connecting u) to each edge of the triangle A. (See Figure 2.) 


1 



Figure 2. Typical solution of a three-person quota game. 

Similar continuous families Involving to exist for higher quota 
games, but do not In general Include all solutions. Their precise nature 
depends upon detailed properties of the function v, and there are many 
cases to be distinguished. We shall prove here a result which generalizes 
the three-person solutions just described to a limited class of higher 
games, and then give without proof a more conplicated example. 

First let us revise our definition of hereafter it will 

denote an arbitrary curve connecting the points eL and p along which all 
the coordinates, and their sum, vary continuously and monotonically (but not 
necessarily linearly) . In our usage up to this point d. and ^ have never 

differed in more than two coordinates, therefore the revised definition 

1 2 

could have been employed from the start. 


^^TGEB 60 . 5 . 3 , with a^ + ag + = 0. 

^^Under the old definition the theorems of this section are still correct, 
but less general. 
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THEOREM 5- If ^ 1 and b£ ^ 1 are otherwise 
arbitrary fionctlons from I into Itself; If the vector 
T satisfies 

('^s) ° < ‘'i < ’ (all 16 1); 

and If, finally, the Ineqiaallty 

('*5) + “j > v((b^, b^, j)) 

holds whenever 1, b£, and j are distinct and 

and Cj are positive; then 

U lb. lbs 

161 (1 - ^ 

solves the quota game v If u) Is In A, and 

U ni iob. lobi 

161 - "^i)^ ^ h 

solves It If (A) Is not In A, o being the weak player. 

For b *= b', this reduces to Theorems 5 and k, For 111 = 5, 
(43) Is no restriction, and we obtain the results alluded to at the 
beginning of this section. For four-person games with a weak player o, 
the theorem yields new solutions If one takes b and b' so that for each 
1, b| = o If and only If b^^ = o. But the theorem Is unproductive for 
constant-sura games with u) Interior to A unless the number of players 
exceeds five. 

VERBAL DESCRIPTION OF THEOREM 5- A player may have two 
beneficiaries, provided that It Is not possible for them to form an effec¬ 
tive three-person coalition with some other benefactor. The rule by which 
the benefits are split Is arbitrary (but fixed under the standard of 
behavior), except that neither beneficiary’s share decreases as the other’s 
Increases. 


PROOF OF THEOREM 5. Suppose that a> Is In A, and define for 
convenience; 

, lb. IbJ 

(46) v^ = [w, (1 - ^ + X^X 1] . 


(I) To show A - dom C Divide the <A- In A Into the three 

categories of (32). In case (1) we have G (1, j}-dom u). In case (11) 
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there is a unique p G with by the monotonicity of V^. 

Either 


(hi) 


(ila) dL = P, or 


(iib) oL^ < for k = bj^ or k = b£ . 


In case (iia) we liave cl G V^. In case (iib) we can find, using mono- 
tonicity and the i‘act that P ^ w, points in near p which 

li, k)-dominate ck- In case (iii) we have cl = Ca). Hence every imputation 
is in either V-^^. or dom V^^.. (II) To show Vi_^. C A - dom Vbb'- 
Proceed as in the proof of Theorem 5, observing that the hypothesis (43) 
exactly excludes the possibility of S-dominatlon for |S| = 3* This 
establishes (44). The proof of (45) is similar. 

Theorem 5 provides a family of solutions connecting and V^,, 

assuming condition (43) is fulfilled. The next theorem illustrates one of 
the more elaborate "connections" that are found in some cases in which 
(43) does not hold. The solutions "connected" are Vj^ (at e = 0 ) and 
Vj^, (at e = 1 ), where 


(48) ^ 




(all i ^ j, k, 1 ) , 


(49) 


THEOREM 6 . If a) is in A, and if 
^ '^1 < ^jki' 


for some distinct j, k, 1 ; then, for arbitrary m 7 ^ k 
and n 7 ^ 1 , the set 

( 50 ) [(*3, (1 - e)y*^'^ + u u 

Ci>eCj 
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is a solution of v for o < © < lA (Figure 3ab); 
the set 

(51) (1 - u [w,ir^] u 

U [(’ - (1 - e)cj/cj^)ti) + ((1 - e)Cj./c^)if^^,y^^] 

CjL>(l-e)Cj 

is a solution for l/2 < e < 1 (Figure 5d.e); and, if 
we also have 

(52) Cj. > (aO-l 1 > 1 ^ j, k, 1) , 

then the set 

(53) [w, (1 - e)irj^ + eyj^] u [u>,jf^] u [w.ir^'^l 

“ ^Vj.k.l + (ecj/c^)!f“^) 

c^>c./2 

‘'4.^j,k,l + (ecj/c^)r^^) 

C^Cj/2 

is a solution for e = l/2 (Figure 5c). 

Among the noteworthy features of these solutions are the follow¬ 
ing: (a) Some of the segments in ( 50 ) and (51) are detached from cu; 
thus there is a positive lower bound, (equal to ecj in ( 50 )) for some of 
the benefits, (b) Some of the segments disappear entirely; thus 1 is 
not a benefactor in ( 50 ) if 0 < c^ < ec^., 1 ^ k, 1, yet he always gets 

more than his minimum, (c) Isolated points occur in the central case (53) 

whenever c./2 < c. < c. for some 1 ^ k, 1; these can lie in the Interior 
of A. 

As Figure 5 reveals, the family of solutions is not continuous 
in the usual sense.** ^ Its "connectivity" is similar to the "connectivity” 
of the set of all solutions to a constant-sura three-person game, a property 
which has not yet been given an adequate characterization. 


^ ^If it happens that Cj < c-A for all 1 ^ j, k, 1, then the family of 
Theorem 6 is lower semi ““ continuous. 
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Figure 3- Two-dimensional sections of A through 
o>, illustrating the connection between and V^, 

obtained in Theorem 6 by varying e. (The letter ”1” 
stands for a typical member of I - (j, k, Ij.) 
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^ 7. EXTENSION OP RESULTS 

By known methods one can readily: 

(a) solve a class of strategically equivalent games, given a 
solution to one of them; 

(b) obtain a solution to a decon 5 )osable game, given a solution 
to every con 5 )onent; 

(c) obtain a solution to each coinponent, given a decoii 5 )osable 
solution to a decomposable game; 

(d) given a solution to an n-person game, obtain a solution 
to its (n+1)-person zero-sum extension; 

(e) given a solution to an n-person game lying within a face of 
A (a "completely discriminatory" solution), obtain a solution to the 
(n-l)-person game formed by removing the player in question. 

Let denote the set of ordered pairs <v,V>, where v is 

In and V Is a solution of v given by Theorems 5-6. Let be 

the smallest set containing and closed under the extension operations 

Indicated in (a) - (e) above. The set Q* of games occurlng in then 

represents a class of games solvable directly or indirectly by the results 
of this paper. ^ ^ The dimensions of the sets of essential n-person games 
In reduced form in Q are as follows, for small values of n: 


Games In 


n 

General-sum 

Constant-sum 

2 

0 

(none) 

3 

3 

0 

4 

7 

3 

5 

T9 

7 

6 

31 

19 


(Compare the table on page 3^7 above.) The present sets are not convex. 
Hence, although substantial improvement over Gi Is apparent in for exaii 5 )le 
the five-person constant-sum case, the dimension numbers do not fully 
Indicate the effectiveness of the extension. 


'•^^TGEB 57 . 5 , ^ 4 . 5 , 60 . 4 . Although not mentioned in TGEB, (e) is easily 
verified from the definitions. 

^^Thls process of extension can of course be applied to any class of 

games with solutions (compare TGEB 54.2.1). In the present case it turns 
out that (d) and (e) are most powerful, while (b) contributes nothing. 

L. S. Shapley 


Princeton University and 
The RAND Corporation 




ARBITRATION SCHEMES FOR GENERALIZED 
TWO-PERSON games’ 

Howard Ralffa 

1.1. INTRODUCTION. Jolin von Neiimann and Oscar I. Morgens tern 
in [9]^ analyze the discrete zero-sum two-person game and Indicate that to 
each such game there exists a unique value. The solution of this type of 
game has a strong stability In the sense that if both players are made 
aware of a saddle point (In the generalized space of mixed strategies), 
there is no tendency for either player to act out of conformity with the 
predicted mathematical solution. However, In the two-person non-zero-sum 
game, no attenpt Is made In [9] to establish the solution as a unique 
element, but the solution Is aeflned as a family of imputations which is 
characterized by a set of requirements. It is felt that this multiplicity 
of solutions is in harmony with realizations of this mathematical model 
(e.g., the duopoly or the duposony behavior in economics). The actual 
solution in a given real life situation depends on the psychological be¬ 
havior of the players in this bargaining problem. In essence, we are faced 
with the problem of the two players choosing a "best" element from a set of 
incojiparable elements. The Inability of the contestants to arrive at a 
mutually satisfactory return in this bargaining situation often results 
empirically in the playing of the non-cooperative game. The Inputation 
thus attained is not, in general, an element of the solution set and there¬ 
fore is dominated by some inputations of the solution set. In situations 
of this type it behooves the players to offer their case for arbitration. 

To be objective, the arbiter must seek an imputation from the solution set 
which satisfies a set of so-called "fair" requirements which is dictated by 
the sociological, economic or political environment in which the game is 
embedded. Motivated by the role of arbitration in collective bargaining 
disputes, we define a scheme of arbitration as a mapping from a given 


The preparation of a more complete version of this work was sponsored by 
the Office of Naval Research. See item [10] in the bibliography at the 
end of this paper. 

^The numbers in square brackets refer to the bibliography at the end of 
this paper. 
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generalized two-person game into a unique element of the solution set of 
that particulao? game. We shall Initially require that the domain of the 
arbitration mapping shall at least include all two-person games with a 
finite number of pure strategies. Various conditions are inposed on the 
arbitration schemes, and this paper shall attenpt to construct mappings 
satisfying these desiderata. No attenpt will be made on the formal level 
to single out a "best" method of arbitration; however, certain provocative 
games will be arbitrated according to different conventions to aid in the 
subjective evaluations of these conventions. The results and motivations 
for this paper were ootalned independently of the work of J. P. Nash, Jr., 
on the two-person non-zero-sum game. 

1.2. UTILITY MEASUREMENT. Ve will follow von Neumann and Morgen- 
stern in hypothesizing a numerical utility determined up to the group of 
positive linear transformations. However, in this paper two distinct cases 
will be considered.; the existence or non-existence of a common unit of 
measurement. In the former case we will require that the theory be in¬ 
variant only up to utility transformations on the players’ payoff entries 
that do not destroy the interpersonal conparison of the unit of measure¬ 
ment. In the latter case we require Invariance up to independent utility 
transformations. Further, in the case where a common unit is hypothesized 
we will distinguish between the cases where side payments are or are not 
permitted. For example, the entries may be in monetary units but physical 
barriers might require that no exchange take place between the individuals. 
In order not to prejudge the problem, the models introduced will incorporate 
all such possibilities.^ 

2.1. MIXED STRATEGY SPACES. 

DEFINITION 1 . Let a = M [« = {^}] be the set 
of pure strategies of player I [II]. If the set a[iB] 
is finite, denote the pure strategies by ^ 2 ’ '**' 

[^1 > ^ 2 ' •••^ ' 

DEFINITION 2, Let [B{cL,fi)] denote the 

return to player I [II] corresponding to a pair of pure 
strategies (ot,|3). In the finite case we abbreviate 
A(«<.j^,/3j) [B(eL^,/3j)] by a^j . 


^Even in the case of a monetary unit it is not quite realistic to assume a 
common unit of measurement. However, it is felt that if one abstracts 
entirely from the interpersonal coirqparison of the monetary unit then one 
alters the basic bargaining structure of the game. 
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EEPINITION 3. Let 

Rq 5 B(<i.,^)):(dL,/8) 6 -a.x») . 

That Is, la the range of the mapping, 

A X B : fl, X # —y where E^^^ r^resents Euclid- 

©an 2 -space. 

IlIFINITION h. Let [P^] be a Borel field of 

subsets of ^ [iB] containing all pure strategies. 

I3EPINITI0N 5 . Let - ($} [S^-^ - {>))] be the 

set of all probability measures over O- [10]. Thus each 
^ [y\] is defined on P^ [F^] to the Interval [0,1], 
and I [>(] is a completely additive measure function. 

In the finite case we let s = '^j] . 

EEPINITION 6. Corresponding to the pair 
associate a vector (A(^,>j), where A(f^,Tj) = 

A(oL,^)d^ d»j ( = ®'ijtl^j discrete case) 

"" -feJcL B(<i,j5)d5 d>| ( = in the dis¬ 

crete case). 

The expressions A(|,y|) and B(|,>j) represent the e^qpected 
returns to players I and II respectively corresponding to the pair 
We explicitly assume: A(oL,|&), B(ot,ia) are finite and summable with respect 
to all (|,^) & Sj X Sjj and the double Integrals are equal to the 
iterated Integrals. Without worrying about the logical niceties we will 
equate the pure strategy oL [j3] with the mixed strategy ^ [>j] such that 
= 1 [>j(p) = 1] ■ In this sense a C Sj and C Sjj. We take the 
further liberty of confusing the eiiqpresslons A(g,T|), A(ot,;8), A(g,jS) etc, 
since the domain of the function will be clear by the symbols used for the 
arguments. 


DEFINITION 7 . Let 

- l(A(|,rj), B(^,Tj)) :(|,ij) G Sj x . 

That is, is the range of the mapping, 

A X B: Sj X Sjj —> . 

In the finite case Sj and are closed sinplexes in ^ 

(Euclidean m-l-space) and respectively; thus these spaces 
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are convex, connected and conipact. 

In the finite case we can write the game ^ as a matrix of the 
form I I (a^j, h^j) I I . For exajiple, the game 


^2 



has a region. 



It should be noted that in general the region of a game is not neces¬ 

sarily convex. It is possible for the players to convexify the region if 
they use correlated mixed strategies. 


2.2. JOINT STRATEGY SPACE. 


DEFINITION 8-a. Let J* = (?) be the set of all 
probability measures over x Pg. In the finite case, 
let Thus > o for all 1, j and 

Sj; j 1 • The space J* will be restricted to a 

subspace J in Definition 8-b (which follows Defini¬ 
tion 9-b) . 


Elements ^ and rj will be called mixed strategies and elements 
i; will be called joint mixed strategies. To every pair (4 ,t^) we can 
associate a joint mixed strategy which is the product measure (i.e., 

4 X vj *= ? where of g sense that we 

will consider Sj x Sjj C J' . 
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DEFINITION 9-a. If A(d^,p), B(ot.,j3) are suinmable 
with respect to any ? G J*, then for any 5 G J* let 

(A(«), B(«)) = B(o«.,/S))de ( = 

In the discrete case). Now define 


= ((A(!;), B(e)) : « G J') ; 

that Is, R^ Is the closure of the range of the map¬ 
ping, A X B : J' —. 

Using the product measure, the product space Sj x Sjj C J* . 
Further, C R^. In the I’inite case we note that R^ is the minimal 
convex set containing R^; and the boundary of R^ is composed of one- 
slitplexes whose vertices are elements of R^. 

DEFINITION 9-b. Let R 2 be the minimal closed 

convex set containing R^ (i-e., the convex hull of 

V- 

Since in the infinite case it is always possible to define R^, 

(o\ ^ 

this definition Is non-vacuous and unique by noting that E^ ' is closed 
and convex and contains R^, and also that the intersection of closed 
convex sets is closed ana convex. Thus for all games we can associate a 
region R^. 

We can give an equivalent characterization of Rg as follows; 
let U be the point set which is the union of all line segments joining 

any two elements of R^. Let V be the point set which is the union of 

all line segments joining any two elements of U. We will now show that V 

is convex. To this ena, let v^ and Vg belong to V, and for 

0 < 6L < 1 we wish to show oLv^ + (1 - dL)v 2 ^ 

elements of U used in defining v^ and V 2 , and let e^, e^, ... eg be 
the elements of R^ used in defining u^, u^, u^^. It is easily seen 

that oLv^ + (1 - di)v^ lies in the minimal convex set containing e^, 

© 2 * ®8* - oL)v 2 lies on a line segment joing two 

boundary points of this minimal convex set. Hence we conclude that V is 
convex. Since the closure of a convex set is convex, we finally have 
V = R2. 

We now assert that if R^ is well defined that R^ = R 2 ' From 
the above characterization of V, it is seen that V is contained in the 
image of J' under the mapping A x B. Taking closures, we get R 2 C R^. 
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That C Rg follows from the observation that the Image of J» Is con¬ 
tained In Rg. Again taking closiires, we get R^ C Rg and consequently 

R^ » Rg. 

Since Rg Is always defined we will have no recourse In the 
sequel to use the notation R^. If the set R^ Is coinpact we will now 
show that the mi nima l convex set containing R^ (In the above notation 
this Is the set V) Is also compact. Since R^ Is bounded the set V Is 
also bounded. It remains to show that V Is closed. Let (v^) be a 
sequence of elements of V which have v for a sequential limit point. 

To show V G V. For each n, we have 

^n ‘^ni®nl '^n2®n2 ^n5®n3 ^nk^nh 

where ^nl ^ ®nl ^ ^o* ^ dlagonallzatlon process there 

Is a subsequence ^n^l —^ ®n^l —®1* further 

X) \ \ ®1 ^ ^o* Consequently 

V = A^e^ + AgSg + A^e^ + A^e|^ 

and thus v G V which proves the assertion. Recalling that V Is con¬ 
tained In the Image of J* we can conclude that If is compact then 

every element of Rg has an Inverse Image In J' . Although In the general 
case, not every element of Rg Is the image of an element of J', this 
will not be a serious handicap because of the context In which Rg Is 
utilized. 

The primary role of region Rg Is In the cooperative game in 
which pre-play communication Is allowed. In this case the players must 
agree on a joint mixed strategy. Although initially we took a rather gen¬ 
eral viewpoint it should now be clear that we can restrict the space J* 
to all normalized measures over the ring of sets of 6L x 8 which consists 
of all sets with a finite number of elements. This effectively eliminates 
any worry over integrability conditions for the expression 
/^x^(A(cl,(J), B(cL,)j))d?. 

DEFINITION 8-b. Let J = {$) be the set of all 
normalized measures over the ring of sets of ^ x S 
which consists of all sets with a finite number of 
elements. 

2 . 3 . COMPOSITE OREER RELATIONS. We now shall define two partial 
orderings of . 
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I3EPINITION 10-a. The element coinposlte- 

ly dominates (x^,y^), 

(Xi ,y,) < s X, < Xg, y^ < yg and + y^ < Xg + yg . 

DEFINITION 10-b. The element (Xg,y 2 ) composlte- 
ly uniformly dominates (x^ ,y^), 

(x^,y^) < (Xg^yg) = x^ < Xg and y, < yg • 

The symbol < shall be construed as follows: 

(xi,y,) < (Xg,y2) = x^ < Xg, y^ < yg • 

An element e of the set U C Is said to be maximal «) 

If there exists no element e* G U such that e ^ e'. Similarly, we can 

define maximal «). In case d x ® Is finite the sets of maximal 

« or elements of R^, R^, and Rg are non-vacuous. In the Infinite 

case to Insure that the above sets are non-vacuous. It Is quite sufficient 

to ln^jose a conpactness condition on the set R^. We state without proof 

(cf. Ralffa [11] for details) that the set of maximal «) points of a 

{ 2 ) 

compact and convex subset of E' Is compact and connected. Hence, If 
Rq Is bounded then the set of maximal (<) points of Rg Is compact and 
connected, for: If R^ Is bounded then Rg Is compact and convex. 

Let the maximal (<) elements of R^, R^, and Rg be denoted 
by Mq, , and Mg respectively. 

The element (|^>[) G Sj x Sjj Is said to be admissible If It 
maps Into a maximal element of R^ . The set of admissible elements, , 
is the inverse Image of . 

Let and ) be two elements of Sj x Sjj. 

Then is said to be equivalent to — 

If* If* have the same Image In R^ (by mapping 

A X B) . 

DEFINITION 11. An equivalence class, H, In 
Si X Sjj Is said to be permutable If whenever 

(^(i)^y|(i)) belong to H, also 

and belong to H. 

DEFINITION 12. The strategy ±3 said 

to be a Bayes solution with respect to the strategy 
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y|(o) [|(o)] (or, is good against 

>j(o) [|(o)j) A(|,r|^°^) 

“ sup B(^^°^y|)]. ^ 

DEFINITION 13- The pair of strategies 
is an equilibrium ^ point if each strategy is good 
against the other- If a pair of pure strategies, say 
(dL^°^ ), is such that each is good against the 

other, then the pair is called a saddle point. The 
totality of saddle ana equilibrium points of a given 
game will be denoted by and E^ respectively. 

To illustrate some of these definitions we return to the - example 
given by Figure 1 . The strategy pairs (d.^, ) and 

admissible and saddle points. However, these elements are not equivalent. 
The strategy pair where = (3/8,5/8) ajid = 

(1/4,3/4) Is an equilibrium point. The elements (2,1) and (1,2) are 
the maximal elements of the regions ana R, • The region Rg Is the 

minimal convex region containing R^, which consists of the four vertices. 
The set of maximal elements of Rg is the segment from (1,2) to 
(2,1). 

2.4. strictly: COMPETITIVE, CONVEX AND LINEAR GAMES. We shall now 
consider an important subclass of two-person games which we shall call 
strictly competitive games. These games are characterized by the fact that 
the elements of R^ are Incomparable in the conposite ordering (<). If 
each player sinply orders the terminal outcomes of the game according to 
preference, then in strictly conpetitive games the orderings of both players 
are exactly reverse. Hence the players have strictly opposing interests 
with respect to pairs of pure strategies. 

LEMMA 1. In a strictly conpetitive game the set 
Eq of saddle points (assuming E^ ^ jll) forms a per- 
rautable equivalence class. 

PROOF. Let and be a pair of saddle points. 

Since is a saddle point we have 

a) A(dL2,^1 j ^ A(<sJ ), B(aL’ < B(ol’ ,, 3') • 


*^The concept of equilibrium point was first introduced by Nash, [4]. 
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Since the game is inconfiarable, we have from a) 


b) A(oiJ,|S 2) > A(<c’,p’) . 

p p 

But (c^ ,P ) is a saddle point and thus 

c) A(o«.^,/J^) > A(<*’,(5^), B(c(v®,p^) > B(A®,/s') . 


From b) and c) we have 

d) A(a®,, 3^) > AU’.^M. BU^,(i^) >B(dv’,/5’) . 


Since the game is strictly con 5 )etltlve, both equalities must hold in d) and 
therefore equalities must hold in c), b) and a) . Consequently, we have 

=: (<k' ,p^) ^ . Q.E.D. 


A strictly cott 5 )etltive game is said to be convex if C 
(i. e., every element of R^ is maximal (<) in the set Rg). Thus in a 
convex game all pairs of pure strategies are conipositely admissible. 

A strictly competitive game is said to be linear if = R^ ~ 
a segment of a line. Otherwise a game is said to be non-linear. A linear 
game is also convex, and also ^ 2 ' 

The concepts of strictly competitive, convex, and linear games 
are invariant under independent positive linear transformations of the 
payoff entries. The linear game is a natural generalization of a two-person 
zero-sum game. In a linear game no aasumptlon need be made on a common 
unit of measurement between the two players. 

A game is said to have a non-cooperative solution if n 
forms a permutable equivalence class. The imputation corresponding to this 
equivalence class will be called the value of the game. J. von Neumann*s 
solution of the zero-sura two-person game would be a non-cooperative solu- 
tlon in our sense.^ 

If both players are aware of the above non-cooperative solution 
of a game (provided it exists) then there is no advantage for either player 
to act out of conformity with this solution. Furthermore, even if both 
players were permitted to enter a cooperative game without side payments 
and without correlated mixed strategies (but with pre-play coraraunicatlon) 


^For a more detailed treatment of the non-cooperative two-person game the 
above definition is too restrictive and is generalized in Raiffa [ 10 ]. 
These definitions differ with those proposed by Nash [ 5 ]. 



370 


RAIFFA 


then there still would not be any composite motivation to move from this 

solution. , . 

If is such that max min A(|,b) - min - v, 

i6Sj ’jCSj.j 

then and v, are said to be the maxlmin strategy and value reroec- 

tively for player I. Similarly there will be a maxlmin strategy and 

nijBTiitiin value Vg for player II. The element (v^ ,Vg) will be termed the 
(.nitmnHitft itinvimin value . To Show the d^endence on a partlciilar game ^ 
we shall employ the symbolism (v,,Vg)(»). 

We also observe that If Is an equilibrium point then 

2 (v,,Vg) 

where (v,^Vg) la the composite maxlmin value. To verify the above asser¬ 
tion let be a maxlmin strategy. Now since Is good against 

^ ^ we have 

V, =mtoA(4^°^i^) < A(g^°^>|^’^)< • 

Similarly, Vg < ^ ^) which proves the assertion. 


2.5. REGION CORRESPONDING TO A TRANSFERABLE UTILITy. Thus far 
In Section 2 we have not assumed any common imlt of measurement. However, 
if there exists a common \mlt of measurement and side payments are per¬ 
missible then It Is possible for the players to achieve Imputations outside 

of R„. Let c = max lA{d.,&) + B(«*,p)]. In the infinite case this is 
2 ck p 

ESSuniBd to ©xlst. (Fop exanipley It is quit© sufficient to assume coinp&ct- 
ness for CL and and continuity fop A and B.) 


DEFINITION 16. Let Ej = {(x,,Xg) : x, + Xg < o). 

The set of maximal (<) points, Mj, for Rj la 
[{x,,X 2 ) : X, + Xg = c3. 

To summarize, we have defined four sets in E' ' with the in¬ 
clusion relations C R, C Rg C R^. In the non-cooperative game and the 
cooperative game with independent mixed strategies we must consider 
and R.|; in the cooperative case with dependent mixed strategies we must 
consider Rg; finally, R^ pertains to the cooperative game with side 
payments. 


f 3- THE COOPERATIVE GAME 


5.1 . By using joint strategies 5 G J, the players can come 
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arbitrarily close to any element of Rg (Indeed, if R^ is compact all 
elements of Rg are attainable). Hence, in the cooperative game with 
pre-play communication and without side payments, the players should confine 
themselves to consideration only of the maximal elements. Mg, of Rg, 
since any element of Rg not in Mg is composltely dominated by some ele¬ 
ment of Mg. Thus if Mg consists of one element the game is trivially 
resolved. However, if Mg consists of more than one element then the 
elements of this set are composltely Incomparable. Define the solution set 
of the game as the totality of elements of Mg which dominate (O the 
coD 5 )oslte maxlmin value (v^ ,V 2 ) of the game. Motivated by our discussion 
of Section 1 .1 we define a scheme of arbitration as a mapping tf from a 
game into an element of the solution set. More specifically, we have: 

CONDITION 1. ^ > EV^ (^,47), VgC^,^)] G MgC^), 

where the game ^ is given by the payoff functions 3(0*“,^)}. The 

pair [V^(^,(r), Vg(^,^)] shall be termed the value of the game relative to 
the arbitration scheme and this value shall be an element of the set® 

Mg, which in turn depends on f • We wish the domain of the mapping to 
Include (at least) all games with a finite number of pure strategies. 


CONDITION 2. 
(v^ ,V2)(^) . 


For all p [V, (^,5), } 


Condition 2 Inplies that the value of a zero-sum (linear) game 
relative to the convention 4/ agrees with the von Neumann solution. 

It might seem natural to iinpose conditions on the mapping ^7 
such that: if ^ has a non-cooperative solution in sense of 2.4 then the 
arbitrated solution shall agree with this result. If we consider the 
following game: 


2 - 


( 1 , 10 ) 
( 2 ,. 01 ) 


h 

( 0 , 0 ) 
( 0 , 0 ) 


we note that (2,.0i) is the non-cooperative solution, ((o,.0l) Is the 
ooniposlte naxlmln value). However, If this game Is to be Inteipreted with 


^ Is to be Inteipreted as a game with a common \inlt of meas\jrfflnent 
and with side payments allowed, then In Condition 1 we r^lace ^2^9"^ 
with Kja) * 
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pre-play communication, player II can make a good case for something closer 
to (1,10) by threatening to play (not that II wants to actually play 

Pg). Thus we see that even if the solution of the non-cooperative game is 
extremely stable it might not be a realistic solution in the case of pre¬ 
play communication because of the potential threat powers of the players. 

We now exhibit a rather general method for getting a mapping ^ 
which has as its domain all games with a finite number of strategies. This 
domain can be enlarged, but the writer does not think it adds anything con¬ 
ceptually. 

Consider a family *7* = (T) of mappings, where each mapping T 
(generic symbol) has as its domain a region and as its range a set 

(where R^ and Mg correspond to some game ^), i.e., T ; R^ —> Mg, 

such that T is point to point and 

a) T is continuous 

b) T(e) ^ e for all e G R-, 

c) If T(e) = T(e’) then T(pce + (1 - o{.)e’) ~ T(e) = T(e') 

for e, e' G R^ and all o ^ ^ 1 such that eke + (1 - ot)e' G R^ • We 

further assume that to each distinct pair (R^,Mg) there exists one ana 
only one T. 

For each game ^ with regions (^) > Mg(^) we have a mapping 
T and we now consider the composite mapping: 

Sj X Sjj -^» Mg 


where 

— > (a(4,tj), b(4,>j) —> T(A(4,Ty), B(4,y|)) = (A‘(4,>/), b*(|,^)) . 

Relative to the family we associate to each game ^ = (A(o(.,( 3 ) B(d,^)) 

a new game = (A'(|,YJ), B»(|,>J)). The set R^^ of game is now con¬ 
tained in the set Mg of The game is now a convex game and con¬ 

sequently if saddle points exist they form a permutable equivalence class. 
Theorem 1 , below, asserts that for all ^ with a finite number of pure 
strategies the induced has a saddle point. The value of the game 

will now be termed the solution of ^ relative to the arbitration scheme 
(we identify the family of mappings with an arbitration mapping). The 
motivation for the above section should now be clear. Since we wish the 
arbitrated solution of ^ to be an element of Induce a new game 

whose payoff values are all contained in Mg(^) . Thus, given a family 
satisfying a) - c) above, we get an arbitration scheme which automatically 
fulfills Condition 1 . The validity of Condition 2 follows from considera¬ 
tion of requirement b) for each mapping T of the family 47 ', as follows: 
If maxlmln strategy and value for player I in ^ then 
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guarantees a security value at least as large as In by 

property b) of T- Hence the conposite maximln value (v^',vp of is 

such that (vj,v^) > (v^ ,V2) . We have also seen that the value correspond¬ 
ing to an equlllbrlimi point is greater than or equal to (>) the coirposlte 
maximln value. Hence we see that Condition 2 is satisfied. 

To prove Theorem l we will utilize the following lemma which was 
first proved by von Neumann, who utilized the Brouwer Fixed Point Theorem; 
it was later proved by Kakutani as an immediate consequence of the Kakutani 
Fixed Point Theorem (cf. Kalcutanl [2]). 


LEMMA. Let and be two bounded, closed 

rn n 

convex sets in Euclidean Spaces and respec¬ 

tively. If U and V are two closed subsets of 

S^ X S„, such that 
m n' 

U^(o) = G U) 

and 

v^(o) - G V) 

are botli non-errpty, closed and convex subsets of 
and respectively, lor all G and 

G S^, tlien U n Y • 

THEOREM 1 . Let ^ be a two-person game with a 
finite number of pure strategies. Let be a family 

of mappings satisfying a) - c) above.^ The game 
induced by has at least one saddle point. 


PROOF. Let S^ and S^ be the probability spaces of players I 
and II respectively and let 


and 


U = ((|,)]^) : 


) = 


max 

*1 




^Property c) of the T mapping is invoked to guarantee that the image sets 
of a point to set mapping slaall be convex as required by the Kakutani 
Fixed-Point Theorem. Property c) could be weakened appropriately and the 
Ellenberg-Montgomery Fixed Point Theorem utilized, (cf. Eilenberg, S., 
and Montgomery, D., [i] .) G- Debreu has recently proved a saddle-point 
theorem using the Ellenberg-Montgomery results (unpublished). 
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V* Uiyi]) : « max A’(^,t|)) . 

That is, U is the set of elements (|,y)) for which y; is "good against*' 

I relative to the game and V is the set of elements for 

which I is "good against" t) relative to the game Since the mapping 

T [ (A X B) ] is continuous on S^^^ x it follows that U is closed. 
Similarly V is closed. The set 


U 


|(°) 




is non-empty and closed because of the compactness of and from con¬ 
tinuity considerations. As regards convexity, let ^^(o) >)'(o) 

belong to U^(o) and let mM = mQ- Then ^ 

T [(A X =T [(A X B)(|^°^,y|'(q))] = iBq- From property c) 

of mapping T, and the restricted linearity of A x B It follows that 
T [(A X + (1 -“ mQ and thus 

^T*(o) ~ *^^^*(0) tielongs to ^g(o) * Similarly, the set 

^ ,( 0 ) 


,{o) = ‘^„(o) = (0)'*?^°^) - max A-(|,V“') 

I *1 " * 


is non-empty, closed and convex. Consequently, U nY/jlf- Let 

G U A V. Then is "good against" and is 

"good against" and therefore is a saddle point. Q.E.D. 

If ^ is a linear game then the appropriate T mapping for ^ 
is the identity mapping (follows from condition b); and, consequently, as a 
corollary to the above theorem we have that all finite llneEir games have a 
non-cocperative solution. 

We will show that the family of T mappings satisfying 

properties a) - c) is non-empty by considering various specific con¬ 

ventions. If there exists a common unit of measurement and side payments 
are permissible then let = (T) where each T : —•> M^. The induced 

game is then a constant-sum game and by the same argument has a saddle 

point; again these saddle points form a permutable equivalence class which 
yields the arbitrated solution relative to the convention 47 * • 


5.2. If a slight perturbation of the payoff entries would result 
in a drastic change in the arbitrated solution, then the convention would 
not he stable enough to he practical. After all, the payoff entries are at 
best only hazy appraisals of the possible terminal outcomes of the game. 

The desire to capture this continuity notion motivates this section. 

Let ^ = {(A(o(,jft), B(o*,/8))} be a game defined over the product 
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space of pure strategies ^ x 28 . A sequence of games 


fvi ^ 

each defined over ^ x ^ is said to converge to the game ^ if for each 
((A,A) e a.x l6 it follows that llm (Aj^(o^,/S), » (A(o(,/W, 

A sequence of sets CH^^} in E^^^ is said to converge to the 
set H provided for every h G H, there exists a sequence of elements 
hk ^ ^k "" conversely, for every h' which 

"belongs to the complement of H there is a neighborhood of h' which 
intersects at most a finite number of 

If the sequence of games converges to the game ^ then 

the sequences of sets R^, R^, Rg, R^ of converge to R^, R^, Rg# 

of ^ respectively. However, it does not follow that the sequences of 
sets Mq, M,, Mg of converge to M^, M,, Mg of ^ respectively. 

CONDITION 3 . If the sequence i^-^] converges to 
^ such that converges to Mg(^) then 

1^ Vg(^i^,6r)l = [VT(^,£r), V2(^,47)] . 

An arbitration scheme ^ satisfying Condition 3 will be called stable . 
From consideration of the sequences of games > 


h- 


( 0 , 0 ) 


( 0 , 1 ) 


( i 0) 

( 0 , 0 ) 



which both approach the same game one can readily see the dilemma to 

be faced in deciding on a convention with continuity properties. For this 
reason we require convergence of ^ ^ Condition 3 . 

If the arbitration scheme ^ is to be identified with a family 
5 r = [T) of mappings, then stability of 47 requires a bond between the 
mappings T of the family 

3.3. The game « ((C(^,c^), D(j6,c*.))} defined over 33 x ^ will 

be said to be the transpose of the game ^ « l(A(ok,p), B(ci,j 3 ))} defined 
over A, X ® provided that C(^,^) ** B(ci,P) and D(p,'^) — A(o*‘,jJ) . Thus the 
transpose of a game results from an interchange of the roles of the players. 

CONDITION k . [V^ (^, 9 ), ] = 
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for all ^ in the domain of the 
mapping An arbitration scheme, 0, satisfying 

Condition 4 will be said to be symmetric. 

5.4. We indicated in Section l .2 ttiat we would require our 
theory to be invariant up to various utility transformations, and, further, 
that we would distinguish between the cases of a common and a non-common 
unit of measurement. We first take up the case of the common unit of 
measurement. 

Let Uq be a 1 <—i transformation of onto Itself 

which takes the following form; for each there exists a real number 

X> 0 and two reals c^ , such that 

Uo(x,y) = (Ax + c^,Ay + c^) . 

A transformation of the above form is said to be a utility transforma¬ 

tion preserving the common unit. 

CONDITION 5A. CV^ (U^^,5) , = 

Uo[Vi(^,ir), for all ^ in the domain of the 

mapping and all utility transformations, U^, 

preserving the common unit; where 

= U^((A(<*,p,), B(ol,p))) = lU^(A(<^,jS>), B(cA,p>))) . 

An arbitration mapping if satisfying Condition 5A is 
said to be invariant up to a common unit of’ measurement. 

3.5- We shall confine ourselves to the discussion of conventions 
for which the arbitrated solution is invariant with respect to any permuta¬ 
tions of the pure strategies of 6L and 28 - All conventions will be 
understood to have this invariance property. If permutations [by a permu¬ 
tation of a (possibly) Infinite set of elements we mean a 1-1 mapping of 
the set onto itself] of the elements ol (L and send cX into cK* and 
f) into then we shall let the game Induced by these permutations be 

= {(A*(cK*,p*), B*(**,p*))) = [(A(e^,^), B(<*.p))) . 

CONDITION 6. If is a game Induced from 

defined over Cbx £, by permutations of the elements 
of (2/ and 3 then 


V2(^,3)] . 
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A game ^ with a common unit of measurement is said to be sym¬ 
metric If there exist permutations of ^ and 10 inducing the game 
and a utility transformation 11^ such that is its own transpose. 

If ^ is symmetric then there exists a value c such that the regions 
R^, R^, Rg of are symmetric about the line through (o,c) with direc¬ 
tion numbers (1,1). For exaniple, the game 





h 

(- 10 , -n) 

( 1 , 1 ) 


is symmetric (permute (ot^ , 0 ^, 2 ) to (o^g,®^^) and let = (x - l,y)). 

For any arbitration scheme ^ satisfying Conditions 1, 4, 5 A, 6, the arbi¬ 
trated value for is ( 3 / 2 , 1 / 2 ) . 

It should be noted that a game ^ may be asymmetric although R^, 
R^, and Rg of ^ may be symmetric about some line with direction numbers 
(1,1). An example of such a game is of Section 2 .1 whose region R^ 

is given in Figure 1 . 


3 . 6 . In this section we shall give an exan 5 )le of an arbitration 
scheme, satisfying Conditions 1, 2, 3 , 4, 5 A, and 6. We shall 

identify with a family of mappings (T^) satisfying a) - c) of 

Section 3 . 1 • We shall first characterize the arbitrated solution for the 
finite case and then indicate some generalizations to the infinite case. 

Let ^ have regions R^, R^, Rg. Corresponding to the game ^ 
we shall define the point to point mapping T^ ; R^ —•> Mg. First define 
Tq for a subset Q of Rg. Let e G Q if there exists an e* G Mg such 
that the ray e to e' has direction numbers (1,1) and then define 
TQ(e) = e’. Now extend the mapping T^ from Q to Rg by requiring that 
for every e' G Mg the set (e G Rg : TQ(e) = e') is connected. This 
extension is unique and thus T^ is uniquely defined on Rg. Now restrict 
the domain to R-j and note that T^ satisfies conditions a) - c) of 
Section 3-1• 

Let us consider the zero-simi game with payoff K(o(,ja) = 

A(o(,^) - B(d,(3) and let us assume that this game has a mlnlmax solution 
(v, -v) with generic optimal strategies and . By the linearity 

of operators A and B we then have A(|^‘^^,/j) - B(^^^^,>?) > v for all 
and -B(^,y|^®^) < v for all f, and A(g^°^ ) = 

) + V. Hence, all elements of the form 
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where are pairs of optimal strategies of lie on a 

ray r^, with direction niimbers By referring to Figure 2 it should 

be clear that depending on the value of v, the ray r^ may or may not 
intersect Mg. 

If we define and (corresponding to T) by the re¬ 
lation T(A X « [T^^^(A X B)(|,T}), T^^^(A x B)(|,^)] and if 

Tq 0 Mg ^ ^ then for the mapping we have 

(A X B)(|^°^Vj) - (a X > V, all J) 

and 

(A X B)(i,»J^°^) - (A X B)(§,v)^°^) < V, all 

Consequently if r^ n Mg ^ then the intersection defines some element, 
say (m^,mg), which is the arbitrated solution of the game ^ relative to 
the convention By choice of a player I gets at least m^ and 

by choice of an , player II gets at least mg. By the inconpara- 

bllity of the elements of Mg, this is an equilibrium situation. If 
Pq n Mg = then the arbitrated solution is one of the end points of the 
continuum Mg which is closest to the ray r^. 

For all finite games the above characterization determines the 
value these cases the value of the corres¬ 

ponding zero-sum game can be actually computed. 

The above characterization for can now be generalized to a 

wide class of infinite games provided the zero-sum game K(ct,|6) = 

A(<A,P) - B(c<.,p) is strictly determined in the sense of Wald [12] or 
Karlin [5]. In general, the arbitrated solution will not be attainable; 
however, the solution (if it exists) can be approximated arbitrarily close 
by the players using a Joint strategy which utilizes at most two pairs of 
pure strategies. 

We have already Indicated that a family of mappings satisfying 
a) - c) can be identified with an arbitration scheme satisfying Conditions 
1 and 2. To verify Condition 5 let * ((Aj^(o(.,/8), approach 

{(A(c^,p), B(ol,j5))}. If Vj^ is the value of the zero-sum game 
Ajj.(cik,^) - Bj^(<i, |5) then we have 11m - v end if we hypothesize 

approaches M 2 (^) then stability of 4/^ follows from the characterization 
of the arbitrated solution. To verify Condition k we note that if K(o<,^) 
is the zero-sum game associated with ^ and K^(ot,)5) is the zero-sum game 
associated with then K^(^,ck) = - K(cA,p) and consequently the value 

of the game K^(^,d.) is (-v,v) . If we now take the reflection of 
with respect to the line y « x then we get the region R 2 (^^) • The ray 
Tq through (v,o) reflects into the ray which goes through (-v,o). 
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still with slope +1 . Again from the characterization of the arbitrated 
solution relative to we have Indicated the validity of Condition 4. 

If we apply the utility transformation to then this region Is 

translated and stretched but not rotated. The transformed ray U^Cr^) 
still has slope +l and an x-lntercept which corresponds to the value of 
the zero-sum game Induced by Hence Condition 5A Is valid. Condi¬ 
tion 6 follows from knowledge that both ^ 2 ^^^ value of the zero- 

sum game, K(oi,A)> remain Invariant with respect to permutations of pure 
strategies. 

We now consider a further rationalization (metatheoretlc) for 
convention besides the ones already mentioned. 

We first note that the ray r^ partitions Into two regions 

denoted by and Qg In the accompanying figure, viz: 



Let us consider the actual bargaining sltioatlon Involved In this game. If 
both players are aware of the region Rg end agree to confine their cooper¬ 
ative behavior to consideration only of elements of Mg, then player II 
desires point F and player I desires point E. In the ensuing argument 
each player Intimidates his opponent by threatening to play non-coopera- 
tlvely unless his opponent will agree to his terms. In jockeying about for 
bargaining advantage a threat by player I to minimize player II's maximum 
possible gain Is not very convincing If at the same time player I has to 
suffer "more than" player II. For example. If player II desires point x 
of Mg (cf. figure) then player I can choose a strategy which will 

guarantee an linputatlon on r^ or In . Consequently, relative to the 
point X player II has "more to lose" than player I In a threat of this 
variety.® If player I wishes point y then by the choice of an 


®Even though we postulate a common unit of measiirement there Is no possi¬ 
bility of formalizing these statements within the undefined terms of the 
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player II can conflr e the result of the non-cooperative game to r^ or Qg 
and thus relatively inflict "a heavier loss” on player I than upon himself.^ 
Thus in the argumentative stage the players threaten to play the non-coop¬ 
erative relative gat^ie — l.e., they consider entries of the form 
{A(dL,ii) - B(c«t,/3)). At point C neither player has a hargaining advantage 
and the correspondir^g inputation is the arbitrated solution relative to the 
convention . 

In the case side payments are permissible then the arbitrated 
solution relative tc.- 3^ has a particularly simple characterization, viz: 


~ ^ value of zero-sum game A(oi,/5) - B(«<,j5) 

Vi(^,^o^ + (AU,p) + B(c^,(i)} . 

Returning to game of Section 2.1, we have 


= < 2,1 ) . 

In this case player I has the bargaining advantage. We also notice that in 
Bayes solution against the maxlmin strategy 
of player II [I] and further is a saddle point yielding (2,1). 


5*7. Ij^ the game ^ is to be interpreted without a common unit 
of measurement then we wish the theory to be invariant up to independent 
linear transformations on the payoff entries. To this end, let be a 

1 <—y 1 trailsfc^rmation of onto itself’ which takes the 'following 

form: for each , there exists positive real numbers , A^ and 
arbitrary reals c^, such that 


U^(x,y) = (A^x + c^,A 2 y + c^) . 

COroiTION 5B. [V^(U^^,3), V2(U^^,3)] = 

V 2 (^, 4 /)] for all ^ in the domain of the 
mapping J, and all utility transformations . 


A game understood in the sense of a non-common unit, is said 

to be symmetric provided there exist permutations of the elements of (L 
and B, inducing game a*, and a utility transformation such that 


utility theory mentioned in Section 1.2. We have gone outside our formal 
framework to obtain a rationalization of a procedure satisfying our formal 
requirements. A realistic realization of this rationalization occurs in 
the case of the monetary payoff. 
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Is its own transpose. All arbitration schemes ^ satisfying 
Conditions 1, 2, 3, 5B, 6 arbitrate symmetric games in the same way. 

3 . 8 . Ve shall now exhibit a family = (T^) of mappings such 
that the corresponding arbitration scheme satisfies Conditions 2 , 3 , 

5B, 6. The writer's motivation for this family of mappings will be given 
in Section 3 . 10 .^ 

Let f be any game with a finite number of pure strategies. 
Define the mapping T^ : R-j (^) —follows: First define T^ 
for a subset Q C Rg. Let e G Q if there exists an e' G Mg and 
e' ( Rq such that the ray from e to e' is the negative of the slope of 
Mg at e'. Then let T^(e) = e'. Now extend T^ to all of Rg such 
that T^ is continuous and the inverse image of any element of Mg is a 
connected point set- This extension is unique and thus T^ is uniquely 
defined on Rg. Now restrict the domain of T^ to R^. 

Since the negative of the slope of any segment of Mg is posi¬ 
tive, Condition b) of Section 3.1 is satisfied. Conditions a) and c) are 
obviously satisfied. Hence we can utilize Theorem 1 to show the existence 
of a saddle point. Since all saddle points form a permutable equivalence 
class we define the common value to be 

In order to prove that satisfies the necessary desiderata we 

10 

shall first find a characterization of the above arbitrated solution. 

Let P^, Pg, ..., P^ be the vertices of MgC^) where P^ = f°i^^i^ 
c^ < Cg < ... < G^. Let the open one-simplex denoted by cr^ 

and let be the slope of cr^. Thus < 0 . Let v^ be the value of 

the zero-s\mi game {A(d,fc) + 7 — B(d,fi)). Hence there exist optimal strate- 

A^i 

glea and such that 

( 5 . 8 . 1 ) A(|<^>,Yj) + ^ all ij 6 Sjj. , 

( 3 . 8 . 2 ) A(|,Yj^^h + ^ < VjL, all ^ e Sj ; 

or since < 0, 

( 5 . 6 . 5 ) B(|^^^lrl) < - .“i A(£^^^l(}) + all Sjj. , 


^J. P. Nash, Jr. has utilized the same family of mappings. 

^^In Raiffa [ 10 ] scheme is reduced by successive utility transforma¬ 

tions to considerations of scheme ^ . The following procedure is 
different and proceeds in a manner suggested by R. M. Thrall. 
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( 5 . 8 .^) all I e Sj . 

Conversely, If there exist and satisfying the equations 

( 5 . 8 . 5 ) A(l^^^ifl) *4. all »| 6 Sjj 

(5.8.6) B(|,«|^^^) > - A(f,T|<^^) + J, aJ.1 | € Sj 

then are optimal strategies and 4/^^ Is the value of the game 

(A(a,ji) + tJ- B(ol,^)). 

Let r^^ be the line y = - We shall now cite three 

mutually exhaustive.cases. 

CASEi. a) If iv,(a,i/,), V^(a,X)] e (T. then r. n o- = 

b) If n ll( then n 0 ^ = 

((V,(^,ir,), V2(f,4/,)]). 

Regarding a); By definition of the saddle point of the game 
(T, (A(i,'»|), B(|,iO)l) we can verify that there exist a and 

satisfying 5 . 8.5 and 5 . 8.6 with J = • Hence we 

conclude T"’ (V, (^,4/,), ^ ^1' 

Regarding b): If r^ n pC then player I [II] can confine 

player II [I] to the region R, below [above] or on r^^; hence b) follows. 

CASE 2. ([V, (^,47,), V2(^,4r,)]] = (1 = 2, 5, ..., t - 1) If 

and only If there exist no element of <r^ below r^^ and no element of 

"^1+1 ^1+1- 

The element is a solution of the arbitrated game relative 

to if and only if in the non-^cooperatlve game player I can confine 

player II (cf. Figure 3) in the region on or below line f and player II 
can confine player I in the region on or above line g. Noting that r^^^ 
is parallel to f and Is parallel to g. Case 2 follows. 



Figure 3 
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CASE 3 . a) ([V, = ?! if and only If no point 

of Mg lies above . 

b) {[V^ ), VgC^,^^)]) « if and only if no point 

of Mg lies below . 

For player II to get the arbitrated solution value of d^ it Is 
necessary and sufficient that he have available a strategy which 

confines the returns of the players in the non-cooperative game on or above 
the line through with slope - This is possible if and only if no 
point of Mg lies above r^ . Part b) is similarly proved. 

Conditions 1, 2, and 6 are immediately satisfied. If 
approaches ^ then the lines rg, ..., r^ defined above for game 
approach the lines r^, ..., for the game f. Since we have character¬ 
ized the arbitrated solution in terms of these lines and the maximal ele¬ 
ments, stability of follows. Consider the game ^ with region 

decomposed into equivalence classes induced by mapping (e is equivalent 
to e* if T(e) =T(e')). The region of together with its 

equivalence classes is the reflection of R^ (^) about the line y ~ x 
since a line with slope m gets mapped by the reflection into a line with 
slope From this, symmetry of the mapping follows. Finally if 

(x,y) = (A^x + c^, ^gX + Cg) then a line with slope m gets mapped by 

Ap 

U. into a line of slope - 5 ^ m. Hence if the slope of one line is the 

I 

negative of the slope of another line, then this property is preserved 
under utility transformations. From this it follows that equivalence 
classes of (^) get mapped by into equivalence classes of R^ (^ 1 ^) 

thus giving Condition 3B. We have thus verified that satisfies our 

inpoaed conditions. 

If we arbitrate ^g of Section 3»i we get 

“ (1 -005, 9 . 995 ) - 

If, however, we can interpret ^g with a common unit of measurement then 

V2(^2,J^)] - (1 . 82 , 1 . 82 ) . 

5-9» In order to show that there exist other arbitration conven¬ 
tions satisfying our conditions we will exhibit another scheme, ^Tg. Let 
4 == , B(ol,jl))) and define c, = inf A(cl,A), tt- == sup - c,l. 


^The following scheme has some serious objections In that It Is not senal- 
tive enough to intermediate values of the payoff entries. The problem is 
open how to impose a further condition which would rule out but not 
uniquely luply . 
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inf X- = sup 


- Cg]. 


We explicitly assume that 


and finite. Since in the case that sup [A(<**,(5) - c^ ] or 

si:p [B(d,|a) - Cg] equals zero the game is trivial, we will rule out this 
possibility. Now for the game, define the normalizing utility trans¬ 

formation U(x,y) = (A^(x - c^), AgCy - Cg)). The utility transformation 
U normalizes the players* entries in the sense that ( if the infs and s-ups 
are attained) the entries 1 and o refer to the maximum and minimum that 
each player can possibly get from the game. We now shall define the scheme 


3 ^, whose domain consists of all f such that 
the mapping 4/^. In particular, let^^ 




is in the domain of 


where U is the normalizing transformation which depends on The 

troublesome conditions to verify are Conditions h and 5B. 

To prove symmetry of ^g, let be the normalizing transforma¬ 
tion and let W(x,y) = (y,x). It is then easy to verify the following 

identities; = W U W or = W U“^ W and == ^tf^' 

V2(^^^2)] =U-’ 

= wu'’w [V,((u^)^,5r^), V2 ((u^)^,5o)] 

= WU"’ [V, (U^,?o), VgCU^,?^)] 

= w 

= ^,(^, 5 ^ 2 )] . 

To prove Condition 5B, let be an arbitrary utility trans¬ 
formation of ^ and let U and be the normalizing utility transforma¬ 
tions of and respectively. Noting that U = and 

U”^ = we then have 

[v,(u,^,47’2), =u‘’ [v,(u,u,^,(r^j), V2(UiU,^,£rQ)] 

-U,U'’ [Vi(U^,44), V2(U^,5 '^j)] 

= U, [V,(^,ir2^' • 


’^¥e can also define a family of mappings = ( 12 ) vhere 

TgCe) = U^’T^UCe). 
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If we arbitrate of Section 3*1 by convention if 2 8©"^ the 

solution (h/3, 200 / 3 ) which seems (to the writer I) more realistic than 
the value ( 1 . 005 , 9-995)• 

3 . 10 . The author's original motivation for convention 3^ stems 
from a linear approximation of the non-linear family of mappings to be 
Indicated In this section. 

Let us consider a game ^ with an Rg of the following form 
(Rg is bounded by (C, D, E, P, G, H)): 



Let the locus of M 2 (^) be given by (x^,f(x^)) for < x^ < or 
(f“^(Xg),X 2 ) for < Xg < Eg. Consider a point e = (e^,eg) In the 
subregion (P, L, G). We wish to map e into some element of the segment 
e’ = (f"^(eg),eg) to e'* = (e^,f(e^)). If we desire a symmetric conven¬ 
tion It is quite natural to map e Into 

e’ + e" + ®i ®2 \ 

2 \ 2 '2 / ' 

It is also evident that this mapping will be invariant with respect to 
utility transformations. With this rationale we can now define the mapping 
from subregions (E, K, P), (P, L, G) and (G, M, H) onto the maximal ele¬ 
ments . In the family of mappings , we merely extend linearly the linear 
equivalence classes of the above subregions. Now Instead of a linear ex¬ 
tension we propose the following: decompose the region Rg into equivalence 
classes through the medium of the differential equation 
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dXg f(x,) - Xg 

•^1 ~ r’CXg) - X, 

where we use the convention that f(x^) * Eg for and 

f“l(x ) = If Xg < Hg. Notice that the Induced mapping agrees with the 

mapping on regions (E, K> F), (Pi Li G) and (Gi Mi H) - It Is obvious 

that the mapping via the differential equation can be generalized to a wide 
class of games with an Infinite number of pure strategies. If the region 
Rg Is bovindedi the elements E and H are the non-cut points of the 
continuum Mg(^) . Although this family of mappings Is perhaps more realis¬ 
tic (sub.iectlve opinion) than the families and ^g It has the serious 

handicap that the equivalence classes of Rg are in general non-llnear. 

In the existence theorem, this non-linearity Is reflected In non-convexity 
of certain sets which prohibits the use of the Kakutanl Fixed Point Theo¬ 
rem. The existence of an arbitrated solution for this non-llnear con¬ 
vention, with the support of a coinputatlonal technique will be left as an 
open question In this paper. 
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